The aim of the article is a presentation of the report of the latest studies carried out at the Faculty of Management and Economics of Services (University of Szczecin, Poland) on analyzing the quality level of two business intelligence system (Power BI and Tableau Public). Analysis was based on the multi-criteria analytic hierarchy process AHP method, a tool that is used for determining the main criteria of BI system evaluation. By structuring the problem based on the hierarchy, it is possible to better understand the level of quality, the criteria to be used and the alternatives to be evaluated. The proposed research concept can be used to analyze business intelligence problems within the framework of specific subjects, such as system quality, quality of analysis, data cleaning and data connectors, visualization etc. Assuming a proper (the best description of the nature of BI systems) selection of descriptive characteristics and transforming them into real determinants, the AHP concept can be used to improve decisions on quality issues in BI system evaluation.