I see trackbacks coming from lot of websites to my wordpress blog. Is it good idea to approve the trackbacks? Does it affect my page rank ?

Sometimes I see no link to my site in the actual external page that generated trackback to my site.. Is this some kind of spam?