There is no way of accessing phone contacts from the web due to huge security problems such functionality can lead to.
Although there is way to access contacts through native applications. You might consider looking into something like PhoneGap that is just a native wrapper around your web application, and it have ability to allow user to share contacts with your application > JS. Then you will be able to modify contacts, add/remove if such permissions are granted to your app.
And check out this documentation from PhoneGap that has some nice functionality that does exactly what you need: http://docs.phonegap.com/en/2.5.0/cordova_contacts_contacts.md.html
For more info, check out this brilliant answer: Get users number from iPhone using HTML5/jQuery