Aside from the intern gifts that all Microsoft interns receive, what you get from your team or organization varies depending on your team.
For example, during the summer of 2020, Bing interns took photos of their sweet Bing bling, and others had awesome shirts, bags, and other swag. For interns who do receive swag, common items include Surface Headphones, a backpack/clothing branded with your product group, a tumbler/mug, etc. Some interns, however, didn't receive anything from their specific team or organization. Big sad.
As a disclaimer, this might have been specific to the pandemic situation. But as a general rule-of-thumb, don't expect any sort of special gift from your team, and if you do receive something, make sure to thank them! Either way, you'll get plenty of free stuff from Microsoft throughout your internship anyway—don't sweat it.