This paper presents a multicriteria analysis approach for measuring and benchmarking open innovation practices of IT organizations. Five important criteria for measuring the open innovation performance of IT organizations are identified. To model the vagueness and imprecision of the decision making process, interval-valued intuitionistic fuzzy numbers are used. Based on the concept of the ideal solutions, the closeness coefficient can be obtained for determining the ranking of the alternatives. This multicriteria analysis approach helps IT organizations to understand their strengths and weaknesses in terms of their open innovation practices performance, and identify relevant areas for improvement.