My two week old wants cuddled or fed to sleep?!?

My two week old cries to be held to sleep, usually by me as when his dad picks him up he starts rooting for food and the second he latches on to me hel suck once and fall asleep, so I'l wind him (even tho he gets very little) and then put him in his ambi hammock bed and he'll just wake up grizzling until I hold him or let him latch on again, I've tried swaddling but he's not fooled?! For the first days he was in neo natal at hospital and wasn't cuddled much or fed normally as his glucose drip made him not hungry.. Now he just wants breast. Fed for comfort and cuddles??