Based on “Girl You Don’t Know Me” by The Impressions (1964).
Hit version by The Larks (US #7/R&B #1 1964).
From the wiki: “Released as a single in 1964 on the Money record label, ‘The Jerk’ was a hit for the Los Angeles band The Larks. Larks’ group member Don Julian wrote new lyrics for their song based on an earlier recording by The Impressions, ‘Girl You Don’t Know Me’, written by Curtis Mayfield.”
The Larks, “The Jerk” (1964):