Palmer began taking drum lessons as a young boy, travelling to Denman Street, Piccadilly. His first band, formed with others from the Midlands area, was originally known as the King Bees, but changed its name to the Craig. In 1966, the band made its first record, “I Must Be Mad”, with flip side “Suspense”, produced by Larry Page. At this time, Palmer also did his first session work, playing on the song “Love Light” by the Chants, a group from Liverpool. Later in 1966, he was then invited to join Chris Farlowe and the Thunderbirds.

Drachen Theaker was the original drummer for The Crazy World of Arthur Brown, founded by Arthur Brown, and played on the band’s eponymous album, including the song “Fire”. Theaker abruptly left the band during a U.S. tour in 1969. Carl Palmer was quickly recruited as a replacement and became a permanent band member.

Vincent Crane was the keyboard player with the Crazy World of Arthur Brown, and both he and Palmer left that group in the summer of 1969 to strike out musically on their own as Atomic Rooster, a trio formed with vocalist/bassist Nick Graham. Palmer reports that Brown himself had “gone missing on a commune on Long Island” and that this was a deciding factor in forming the new band. There were several personnel changes in the band, and their first album was released in early 1970. Meanwhile, Palmer received a call from Keith Emerson to audition for a new group and left Atomic Rooster in the summer of 1970.

In 1973, Palmer commissioned British Steel to design a custom stainless steel drum kit using one-quarter-inch thick shells, the only off-the-shelf equipment were the hoops manufactured by Gretsch. He also had a jeweller engrave the shells with various animals. The kit, along with other percussion instruments and a rotating platform, had a total weight of approximately 2.5 tons and many of the stages on tour had to be reinforced, with some venues cancelling shows because of it. Also, the kit was electronically designed to be “synthesized” to sound like electronic drums.

Palmer met up with two other young English musicians, Greg Lake and Keith Emerson. Emerson had most recently been a member of the Nice, and Lake was in King Crimson, and both wanted to further expand their musical creativity. After discussions with Jimi Hendrix and Mitch Mitchell about forming a group fell apart, they auditioned several drummers, and felt an “immediate chemistry” with Palmer, and by the summer of 1970 they had formed a band. In naming the new group, the trio chose their last names alphabetically – Emerson, Lake & Palmer, also shortened to ELP. The band has been the most successful of his career, and he remained with ELP until they first disbanded in 1980. The band was nominated at the 14th Annual Grammy Awards for Best New Artist, making them the first progressive rock group to achieve this feat. They developed a sound that merged art rock, jazz, electronica, pop rock and classical music and found fans within their peers and the public alike. During that time Palmer released only one single as a solo artist but went on to develop a solo career, alongside ELP and his other future bands. During the latter part of 1981, Palmer played drums on the Mike Oldfield album Five Miles Out, including the song “Mount Teide”. Other recordings that Palmer did with Oldfield, such as “Ready Mix,” remained unreleased until 2001. Emerson, Lake & Palmer subsequently reunited in the early 1990s and played the progressive rock circuit, especially in outdoor summer concerts. They also released two new studio albums. In 1998 the members of ELP had a rather acrimonious falling-out and Lake left the band. Following the deaths of Emerson in March 2016 and Lake in December 2016, Palmer is the only surviving member of Emerson, Lake & Palmer.

Following the first break-up of ELP in 1980, Palmer formed PM with Texas blues rock guitarist John Nitzinger for one album before joining John Wetton and Steve Howe in early 1981, who had been brought together to form a new super-group. They were later joined by Geoff Downes to form Asia. The group was nominated at the 25th Annual Grammy Awards for Best New Artist, making them the second and last progressive rock band to achieve this feat. Palmer became only the second artist to be nominated twice for this award, after David Crosby. Palmer left Asia in 1991 to join the ELP reunion. After several personnel changes the four founding members of Asia including Palmer reunited in 2006.

Palmer rejoined the newly reformed ELP in 1992 for Black Moon, In the Hot Seat, a box set, as well as several DVDs and the subsequent tours. A one-off ELP performance at the 2010 High Voltage Festival celebrated the 40th anniversary of forming the band.

Following the 1998 break-up of ELP, Palmer worked with Asia’s John Wetton in the band Qango, and subsequently toured with his ‘Carl Palmer Band’ featuring Shaun Baxter on guitar and Dave Marks on bass (replaced by Paul Bielatowicz and Stuart Clayton, later Simon Fitzpatrick). In addition to these tours, he has released four “new” albums, most notably Working Live Vol. I,II & III as well as an anthology album.

Palmer has been reunited with the original line-up of Asia since 2006. They celebrated their 25th anniversary, and have since released four new studio albums, Phoenix, in 2008, Omega in 2010, XXX (30) in 2012, and Gravitas in 2014. A live album and DVD from the 2006 reunion tour, entitled Fantasia was released by Eagle Rock Records.

In 2011, Ludwig released his “Signature Venus snare drum”, made of a green-lacquered brass shell with a 3.7″ depth and a 14″ diameter.

In 2013, Palmer went on a world tour that included shows in South and North America, and Europe. For example, he played in Montevideo, Uruguay, for the first time on 7 April. The Palmer’s tour band is a trio, with him on drums and percussion, guitarist Paul Bielatowicz and bassist Simon Fitzpatrick.

On 19 July 2013, it was announced that Carl Palmer would be appearing on the second annual Moody Blues Cruise, 2–7 April 2014 on the cruise ship MSC Ship Divina, presenting instrumental versions of many of ELP’s hits.

On 6 November 2014 in Durham, NC, Palmer embarked on “The 2014 Rhythm of Light Tour”, a 19-date North America tour billed as “Carl Palmer’s ELP Legacy”, which ended on 3 December 2014 in Northampton, MA.

On 2 June 2016 in NYC, Palmer embarked on “Carl Palmer’s ELP Legacy Tour 2016”, a 25-date North American tour. As of 7 December 2016, following the death of Greg Lake, Palmer is the only surviving member of Emerson, Lake & Palmer.

On 20 February 2017 Carl Palmer’s ELP Legacy announced its “2017 Emerson, Lake & Palmer Lives On! World Tour.”

On 22 November 2018 Palmer announced Carl Palmer’s Prog Rock Camp and it’s booked to take place at the 2300 Arena in Philadelphia, PA on 8, 9 and 10 November 2019.

On 2 April 2019, it was announced that Palmer would play with Asia and ELP Legacy during “The Royal Affair Tour” with Yes and John Lodge. Arthur Brown was announced as a guest vocalist during the tour.