Whitley was born in Lumberton, North Carolina. He claims Wilmington, North Carolina as his hometown. He moved to Columbia, South Carolina in 1957 to serve in the U.S. Army at Fort Jackson, and he returned there to attend university in 1965. He served in the 82nd Airborne Division, and N.C. Nat. Guard Special Forces. He has attended Wilmington College (UNCW), Campbell College, and the University of South Carolina. He obtained his B.A. Degree in Language and his J.D. Degree in Law from the University of South Carolina. He currently lives in Columbia. He has a son in Pharmacy and a daughter in Art at university. His background also includes radio broadcasting, motion pictures, and network television as a broadcaster and actor. He is currently working on several novels, screenplays, and other projects. He is one of the few 18-wheel truck drivers and lawyers. He is retired from law practice. Whitley claims to be a "recovering lawyer."