Service oriented architectures (SOA) are widely used nowadays. As the name implies such architectures rely on services. Germany developed a marine‐specific service oriented data infrastructure (MDI‐DE – Marine Dateninfrastruktur Deutschland) from 2010 to 2013. The services in MDI‐DE can contribute to fulfilling reporting commitments for various European and national legislation. The services of MDI‐DE (just like other services affected, for instance, by INSPIRE) have to meet specific requirements regarding performance, availability and conformity (quality of service, QoS). Although SOA is an important field in scientific research there are very few publications and studies available on QoS, especially regarding INSPIRE requirements. The services of MDI‐DE were analyzed using various existing tools. Their usefulness to reflect where either the aspect's performance, availability or conformity needs improvement was partly verified. Due to varying results and the neglect of some services for various reasons it can be stated that the more tools are used, the more conclusive the outcome. Furthermore, service quality was not coherent when measured with different tools. This means that measuring QoS in terms of INSPIRE will be very difficult to do in the future and there is the danger that people will choose the tools with which their services perform best.