Ok, for ambient temps that high and air cooling and no overclock, the idle temps you listed in your OP are roughly what I'd expect. I get about those temps if my ambient is the same as yours with a 1.3v 4.4Ghz overclock, but I am on liquid CPU cooling, so that makes sense.
For a more direct comparison, you could post what your idle temps are with a 1.3v 4.4 Ghz overclock, since that's pretty much what I'm running. With my AIO cooling at 79-82F ambients, I'll generally idle around 32-37c core temps.
Running Aida with ALL the boxes checked will make damn near any PC heat up in a big way, considerably hotter than OCCT large data set, for example. Frankly, if you could run it with all boxes checked and only hit low 80c maximum core temps, you're doing pretty good.
At any rate, to answer your subject line question - with ambients that high, no, I don't think mid 30's core temps are "way too high" at all. Possibly a tiny bit high running at stock, but not by much considering it's air cooling.
EDIT: "but when i overclocked my cpu to 4.4ghz the only thing i changed in the bios was the core multipler and and core volt to 1.3" - you didn't specify whether your "core volt to 1.3" was manual, adaptive or offset. Is "Fully Manual" enabled or disabled? Does your voltage ever drop much below 1.3v when at idle when you watch it In Aida? Note that you do have to be on balanced power plan in Windows (or high performance plan with the minimum processor state dropped to 5-10%) for the voltage to drop.