Jackson was born in the Waterhouse district of Kingston, Jamaica in 1946. One of seven children, Jackson left home at the age of twelve to find work at a furnace in Waterhouse. At seventeen, the effects of malnutrition had left him hospitalized, and on his release he was left with severe arthritis which had partially crippled his legs. His physical condition meant that he was unable to return to his previous work, and he was forced into hustling a living on the streets of Kingston.

Another spell in hospital meant that finding money for recording was difficult, but eventually the “Conquering Lion” single was released late in 1972, credited to ‘Vivian Jackson and the Ralph Brothers’. Cut for King Tubby, the popularity of the song and its distinctive introduction (the chant of “Be-you, yabby-yabby-you”) earned Jackson the nickname “Yabby You”, which has remained with him during his entire career.

Jackson continued to record, produce and perform (often with the aid of crutches) until the mid-1980s. He re-emerged in the early 1990s, issuing both new and old material, and his recordings have been the subject of several high quality reissues in recent years. In 2000 he released a singles remix project with Glen Brown. The album included remixes of “Conquering Lion” by Smith and Mighty, and a remix of Glen Brown by Small Axe and Terminal Head.

He died on 12 January 2010, aged 63, after suffering a ruptured brain aneurysm.

Shanachie Records released a 3-CD box set in 2014. Shanachie Records chief Randall Grass explained in an interview with the website Midnight Raver:

On 14 August 2014, Shanachie Records announced their plans to release a Willi Williams/Yabby You project titled “Unification: From Channel One To King Tubbys With Willi Williams And Yabby You,” which includes tracks recorded in the late seventies and never released.