Although coal swelling/shrinking during coal seam gas extraction has been studied for decades, its impacts on the evolution of permeability are still not well understood. This has long been recognized, but no satisfactory solutions have been found. In previous studies, it is normally assumed that the matrix swelling/shrinking strain can be split between the fracture and the bulk coal and that the splitting coefficient remains unchanged during gas sorption. In this study, we defined the fracture strain as a function of permeability change ratio and back-calculated the fracture strains at different states. In the equilibrium state, the gas pressure is steady within the coal; in the non-equilibrium state, the gas pressure changes with time. For equilibrium states, the back-calculated fracture strains are extremely large and may be physically impossible in some case. For non-equilibrium states, two experiments were conducted: one for a natural coal sample and the other for a reconstructed one. For the fractured coal, the evolution of permeability is primarily controlled by the transition of coal fracture strain or permeability from local matrix swelling effect to global effect. For the reconstituted coal, the evolution of pore strain or permeability is primarily controlled by the global effect.