In the Sims 2, is it possible to have a alien baby with light blue eyes?

Yes, but it's very rare as the ordinary Alien eyes are very dominant while light blue eyes are one of the least likely eye colours for a sim to have.

In summary, possible but very very unlikely