I'd say fold on the flop and wait for a better spot because you said he was pretty loose agro so not much value in the 55 because he can have a wide range of hands. The turn is ok i guess, the only hand that i think would beat me on the turn is A3 of diamonds but i think i wouldn't put him on that hand i would be pretty sure he's on a different diamond draw and pushed like you. At these low stakes those min raises usually mean some big pair like KK or AA which doesn't want to scare everybody away so that would be another possibility.

Your flop action is bad bad bad. You should be in check/fold mode. You played the other streets fine.

fold after flop raise is the right thing

had to edit this post, after reading your posts again. heh, i just woke up. you guys are right.