We know he doesn't have any maternal relatives atau he'd have been sent to those instead of the Dursleys. The protection created sejak Lily's sacrifice would work with any relatives of hers. Any of James' relatives wouldn't have the same protection, and I doubt he had any, anyway, since he was an only child and both his parents had died sejak that time.
