To a certain extent you probably have an efficient metabolism and you will just have to accept that. But the formula for "bulking up" is pretty simple. Eat more. Make sure you are eating plenty of protein. Do strength training. Repeat for at least six months.
I sympathize with your plight since I also have a hard time gaining muscle.