Yeah, but as leaftoad said, the dwelling owner's neighbors could have sensed you.
Picture this:
A Hunter nin plunders a genin's house (I wonder why...)
The genin didn't notice him since he's way too inexperienced. But a sannin next door noticed the hunter nin.
The next day, the genin noticed some gold missing and after asking around, the sannin told him what he saw.
Or there could be guards around the whole village and saw the hunter nin going into the genin's house.
At first, he thought the hunter nin was just visiting and found out otherwise during the next day.
Or something like that...