Various scholars have accomplished a great deal to better understand open innovation effectiveness. Case studies have detailed its performance effects, while other studies showed the effectiveness of an aspect of open innovation, such as collaboration with third parties, external technology commercialization, and cocreation. Though most studies report a positive relation between open innovation and innovation performance, some studies indicate possible negative effects. This has resulted in a call for research on what kind of organizational context suits open innovation best. This study therefore addresses two questions: (1) does performing open innovation activities lead to increased innovation performance, and to which aspects of innovation performance is open innovation most strongly related? (2) what is the moderating impact of various kinds of strategic orientation on the relation between open innovation and innovation performance? In this study, we investigate three types of strategic orientations: entrepreneurial orientation, market orientation, and resource orientation. In a survey among 223 Asian service firms, we first develop and test a comprehensive measurement scale for open innovation that captures the entire range of open innovation activities, including outside‐in activities, inside‐out activities, and coupled activities. The final scale comprises of 10 items and indicates to what extent a firm has implemented open innovation activities. Next, we study the relation between open innovation and innovation performance. The results indicate that performing open innovation activities is significantly and positively related to all four dimensions of innovation performance: new product/service innovativeness, new product/service success, customer performance, and financial performance. The impact of open innovation is not limited to a particular aspect of innovation performance; it positively affects a broad range of innovation performance indicators. Though open innovation is positively related to all four dimensions of innovation performance, the effect sizes are not equal. The impact on new service innovativeness and financial performance is relatively stronger. Regarding the influence of a firm's strategic orientation, we find that all significant moderation effects are positive. This suggests that, in general, having a more explicit strategic orientation enhances the effectiveness of open innovation. When comparing the three strategic orientations, entrepreneurial orientation strengthens the positive performance effects of open innovation significantly more than market orientation and resource orientation do. In turn, market orientation has a significantly stronger moderation effect than resource orientation. These findings provide empirical evidence of the context dependency of open innovation. Especially an entrepreneurial orientation, which is associated with proactive and entrepreneurial processes, seems to create a fertile setting for open innovation.