Knee and elbow protection

I'm going to get my self some gear, but have a question.

I talked to a person who has ridden longer than me and he said that I should get myself knee and elbow protection. But most people that I have seen on the internet (videos) don't wear knee and elbow protection. What should I do?