Quality links pointing to your site increase the possibility of better rankings. Here are some resources to help you identify inbound links to your site.
Bad links pointing to your site can hurt your rankings. A few won't but many will. Have a look at these resources to identify how many you have.
First, you need to understand backlinks & then you can work at getting them. Acquiring backlinks isn't easy. Have a look at this resource page for more.