Fat is one of the triggers I can also push the limits with. For me, I can get fish'n'chip shops chips (which are chunky), but I still can't eat McDonalds fries (which are skinny and so have a higher percentage of fat).
Just be especially careful until you're stable as you can set yourself back if you overdo it.