Mine did this also and when I did the IMS bearing I pulled them out and found 1 kinda stuck. I replaced it and the new one was MUCH stronger. As you can see in this pic, the old on on the left goes in much further than the 1 new one on the right with the exact same weight applied.
I don't think you need to do the full lockup things just to replace the tensioner part that I did. Replacing this eliminated the start up chatter.