Taylor ran for the House in the 1918 midterms, challenging incumbent Republican congressman Richard W. Austin. The latter's lack of popularity in the area led to an easy primary victory for Taylor,<ref name=knoxvillefocus/> who then handily won the general election by a landslide.<ref>[https://www.ourcampaigns.com/RaceDetail.html?RaceID=310760 TN - District 02 Race - Nov 05, 1918]. ''Our Campaigns''. Retrieved August 5, 2021.</ref> The second district of Tennessee has consistently been solidly Republican since the 1860s.
[[File:J. Will Taylor bioguide picture.jpg|thumb|left]]
Popular among constituents, Taylor dominated state GOP politics during the 1920s, when Republican-held presidencies caused all federal patronage in Tennessee to run through him.<ref name=knoxvillefocus/> He was accused of corruption by opponents who even tried to indict him via a grand jury, though such attempts failed to succeed.