Jefferson played clarinet and alto saxophone early in his career, playing in the backing bands for The Temptations, The Supremes, and Little Richard in the 1960s. In 1971, he entered New York University, and played with Mongo Santamaría and with Art Blakey's Jazz Messengers. Between 1977 and 1980 he performed and recorded with Woody Shaw. Following this, Jefferson spent time with Elvin Jones, Roy Haynes, Cedar Walton, Jerry Gonzalez, Malachi Thompson, Barbara Donald, and Jack Walrath. His only record as a bandleader was the 1978 release The Rise of Atlantis, produced by Woody Shaw. He died in Cracow, Poland, in 1993 after an emergency surgical procedure.
With Art Blakey
With Walter Davis, Jr.
- Illumination (1977)
With Woody Shaw
- Rosewood (Columbia, 1977)
- Stepping Stones: Live at the Village Vanguard (Columbia, 1978)
- Woody III (Columbia, 1979)
- For Sure! (Columbia, 1979)
With Barbara Donald
- Barbara Donald and Unity: Olympia Live (Cadence Jazz Records, 1982)
- Barbara Donald and Unity: The Past and Tomorrows (Cadence Jazz Records, 1983)
With Malachi Thompson
- Spirit (Delmark, 1983)
- The Jaz Life (Delmark, 1992)
- Lift Every Voice (Delmark, 1993)
- New Standards (Delmark, 1993)
- 47th Street (Delmark, 1997)
- Freebop Now! (Delmark, 1998)
With Jack Walrath
With Clifford Jordan
- The Mellow Side of Clifford Jordan (Mapleshade, 1989-91 )
- Yanow, Scott. Carter Jefferson at AllMusic. Retrieved March 2, 2018.
- The Biographical Encyclopedia of Jazz, p. PT742, at Google Books
- Stokes, W. Royal (July 1, 1983). "Jefferson Jazz". The Washington Post. Retrieved March 2, 2018.
- Woideck, Carl (1992). The Complete CBS Studio Recordings of Woody Shaw (Media notes). Mosaic Records.
- "Carter Jefferson Discography". Jazzlists. Retrieved March 2, 2018.
- Grove, Lloyd (December 15, 1993). "The Lonesome Death of a Jazzman". The Washington Post. Retrieved March 2, 2018.
- Olympia Live (Media notes). Cadence Jazz Records. 1982.
- The Past and Tomorrows (Media notes). Cadence Jazz Records. 1982.