This paper describes recommendations for the design of a smart phone application enabling users to control IPTV-systems including all connected devices. Recommendations are based on findings from a media study focusing on how people currently use their IPTV systems and associated devices in their homes. The media study applied an ethnographic oriented method called playful probing. From the user's perspective the ideal smart phone application provides them on a general level with a simplified set of (touch-enabled) buttons to control and navigate. The application should support them in their most frequent tasks (e.g. watching TV, listening to music) and overall shall enhance the experience by providing additional information to the TV channel currently selected, by supporting their need for privacy and by allowing them to achieve a certain level of security. In terms of interaction techniques, users prefer flexible touch interaction and (a limited set of) speech commands over gesture, with the exception of being able to directly point at a device to identify it for direct control.