Immigrants’ integration is a multi‐faceted process, involving structural, cultural, social, and emotional dimensions. This study focuses on the emotional dimension of integration, investigating immigrants’ emotional attachments to their national origin and their host country. Specifically, we ask what role perceived discrimination plays in shaping identification preferences among immigrants and immigrant descendants in Germany. The contribution of this study is twofold: First, we present results for three generations of post‐WWII labour migrants of Turkish and Italian descent. Second, we estimate the consequences of perceived individual discrimination for national and ethnic identification separately. The findings indicate that while discrimination is not related to ethnic identification, it is negatively correlated with national identification. Regarding future challenges, we believe that our findings suggest that the German society can come closer to achieving integration of migrants by reducing perceptions of rejection by the immigrant population, or better yet, fighting off discrimination against immigrant minorities.