Red swollen bumps on my arms?

Since I was ten years old, I noticed I've been getting these little pimple-like bumbs on both my arms. I pick at them/squeeze them from time to time, and usually a puss-like substance oozes out, and sometimes it has a hair stuck to it. What are these annoying things and how can I get rid of them?