In 1956, when he was seventeen years old, Gaye left home and enlisted in (joined) in the United States Air Force. He was honorably discharged the following year. Gaye moved back to Washington D.C. and formed a group called The Marquees. The group was discovered by musician Bo Diddley and they recorded the songs "Good Morning Little Schoolgirl" and "Wyatt Earp". They then met Harvey Fuqua and joined with his group The Moonglows. They released a song called "Mama Loocie" in 1959. This was the first song recorded with Gaye singing as lead vocalist. The following year, the new Moonglows split up and with Fuqua as his mentor, Gaye traveled to Detroit, Michigan where they met Berry Gordy, who had formed Motown Records. Gordy was impressed by Marvin's talent as a piano player and drummer and signed him as a session drummer for Motown. Gaye played drums on most of Motown's early hits for artists like The Marvelettes, Mary Wells, the Miracles and Stevie Wonder. In 1961, Gordy signed Gaye as a recording artist and released "The Soulful Moods of Marvin Gaye". The album did not sell well.
Gaye's first became successful when he co-wrote the Marvelettes' top twenty hit, "Beechwood 4-5789". In 1962 he released his own song called "Stubborn Kind of Fellow". It was partly about his own life and got into the top fifty of the pop chart and number eight on the R&B side. His first top 40 single, "Hitch Hike", and his first top ten hit, "Pride & Joy", made him a teen idol. These early singles and those on his second release, "That Stubborn Kind of Fellow", featured Martha and the Vandellas in the backGaye had more successful songs like early success continued with "Can I Get a Witness", "Baby Don't You Do It", "You Are a Wonderful One" and "Try It Baby". In late 1964, Gaye recorded "How Sweet It Is (To Be Loved By You)", which peaked at the top ten of the American pop charts and became one of his first hits abroad reaching the top fifty in the United Kingdom. Gaye also worked with his friend, singer Smokey Robinson to write number-one singles, "I'll Be Doggone" and "Ain't That Peculiar".
After his early success, which Marvin had struggles with, Motown began to widen his role as a ladies man, having him record duet albums with Mary Wells, Kim Weston and Diana Ross. His first album with Wells, "Together", became Marvin's first charted album, and yielded two popular hits, while his single with Weston, the Sylvia Moy-penned "It Takes Two", hit the top twenty on both sides of the Atlantic. But it would be his collaboration with Philadelphia R&B singer Tammi Terrell that landed him his biggest known success in his duet work. Building on songs written by Ashford & Simpson, the team of Marvin and Tammi scored a multitude of hits including their original version of "Ain't No Mountain High Enough", "Your Precious Love", "Ain't Nothing Like the Real Thing" and "You're All I Need to Get By". Their success would be short-lived following Tammi's collapse during a show at Virginia in October of 1967. Having complained of headaches, Tammi was rushed to the hospital that night and was diagnosed with a brain tumor. Terrell braved it out but by the release of their third and last album together, "Easy", was losing her fight with the tumor. Tammi died in March of 1970 at the age of 24 from complications of her brain cancer. Marvin was said to be so devastated by Tammi's death that he said he felt a piece of him died with her, and reports state at her funeral, Marvin talked to her remains as if she was gonna respond. Promising not to tour again and not to record another duet album after that, Marvin went into a self-imposed seclusion that ended briefly. In 1973, Marvin would work on his final duet album with Diana Ross. Their recording was hampered by arguments between them as Marvin refused to stop smoking marijuana in the studio as Diana was then pregnant. The resulting album, "Diana and Marvin", became a top twenty U.S. success and reached the top ten in the U.K.
In 1968, Marvin returned to the top of the charts as a solo act with the Norman Whitfield-penned "I Heard It Through the Grapevine". The song, originally recorded in 1967, was initially blocked from release since Berry Gordy disapproved of the song. Instead, one of its cover versions by Gladys Knight & the Pips was released, and it ended up reaching number-two. Whitfield was determined to get Gordy to release Marvin's, and in October 1968, Motown finally issued "Grapevine" as a single where it eventually reached number-one in December of that year, it also reached number one in the U.K. and became the biggest-selling single in Motown history during the sixties. During this period, Marvin used his "Grapevine" success to produce a collection of singles for his background group the Originals. Those songs, "Baby I'm for Real" and "The Bells" became top 40 recordings. After two more top ten hits that followed, Marvin began working on a more personal production. Inspired by Tammi Terrell's death, his brother Frankie's Vietnam stories, footage of the Vietnam War and race riots in the U.S., Marvin's success with his first productions and a rough draft of a song composed by Four Tops member Obie Benson, Marvin recorded an introspective single titled "What's Going On". Like "Grapevine", Motown refused to release it due to it being "uncommercial" and "risky" since Gordy could not find a song to match anything with and also because Gordy was against anyone in his company to talk openly about serious issues. In spite of releases by the Temptations, the Supremes and Edwin Starr, which opened about inner city struggle, illegitimate pregnancy and wars respectively, Motown was afraid the song would ruin Marvin's squeaky-clean teen pop image. Marvin, confident in his own abilities, stood his ground, and in January of 1971, the song was released quickly becoming a hit single reaching number two on the Billboard pop chart and number one on the Cashbox pop chart, also hitting number-one on the Billboard R&B chart. A follow-up album of the same name was quickly released that May and with accompanying top ten singles "Mercy Mercy Me" and "Inner City Blues", songs that also talked about social issues including environmentalism, the album sold over a million copies and permanently made Marvin one of the first independent artists on the label. Inspired by Marvin's success, Stevie Wonder refused to renew his contract with Motown in May of 1971 after releasing the non-Motown approved "Where I'm Coming From", an album that also dealt with social issues. In 1972, Motown signed Marvin to a $1 million contract, making him at the time the highest-paid black recording artist in music history. Marvin celebrated the contract by releasing the pro-political single "You're the Man", which attacked the Nixon administration. Moving from Detroit to Los Angeles that year, he recorded the soundtrack to the movie, "Trouble Man". The soundtrack and its title track became top twenty and top ten hits on the charts respectively. In 1973, Marvin dramatically changed direction from social topics to sexual politics with the release of "Let's Get It On". The song became Marvin's second number-one Billboard hit and was the biggest-selling R&B single of that year. Its subsequent album became another critical milestone as "What's Going On" had been and with his new look as a wool hat-wearing, studded jean outfit, bearded "messiah", Marvin had become an icon of early seventies soul music.