Abstract: We report the equilibrium vortex phase diagram of a rotating two-band Fermi gas confined to a cylindrically symmetric parabolic trapping potential, using the recently developed finite-temperature effective field theory (Klimin et al 2016 Phys. Rev. A 94 023620). A non-monotonic resonant dependence of the free energy as a function of the temperature and the rotation frequency is revealed for a two-band superfluid. We particularly focus on novel features that appear as a result of interband interactions and can be experimentally resolved. The resonant dependence of the free energy is directly manifested in vortex phase diagrams, where areas of stability for both integer and fractional vortex states are found. The study embraces the BCS-BEC crossover regime and the entire temperature range below the critical temperature T-c. Significantly different behavior of vortex matter as a function of the interband coupling is revealed in the BCS and BEC regimes.

Abstract: Vortices and vortex arrays have been used as a hallmark of superfluidity in rotated, ultracold Fermi gases. These superfluids can be described in terms of an effective field theory for a macroscopic wave function representing the field of condensed pairs, analogous to the Ginzburg-Landau theory for superconductors. Here we establish how rotation modifies this effective field theory, by rederiving it starting from the action of Fermi gas in the rotating frame of reference. The rotation leads to the appearance of an effective vector potential, and the coupling strength of this vector potential to the macroscopic wave function depends on the interaction strength between the fermions, due to a renormalization of the pair effective mass in the effective field theory. The mass renormalization derived here is in agreement with results of functional renormalization-group theory. In the extreme Bose-Einstein condensate regime, the pair effective mass tends to twice the fermion mass, in agreement with the physical picture of a weakly interacting Bose gas of molecular pairs. Then we use our macroscopic-wave-function description to study vortices and the critical rotation frequencies to form them. Equilibrium vortex state diagrams are derived and they are in good agreement with available results of the Bogoliubov-de Gennes theory and with experimental data.