Computer vision and AI at the service of humanitarian health

Operating in over 60 countries, Operation Smile used processes that did not keep pace with the complexity and volume of its global operations. The clinical context demanded precision, speed, and traceability — attributes that depend on a robust digital infrastructure.

• Clinical condition classification: cleft lip and palate screening required field agility, but existing processes did not adequately support rapid and standardized classification of patient conditions.

• Data reliability and efficiency: manual forms and spreadsheets were vulnerable to inconsistencies and made data research and analysis slower and less reliable.

• Report generation: the time required to consolidate and generate operational reports compromised data-driven decision-making.

• Global and multilingual operation: operations in over 60 countries required support for multiple languages and the ability to capture and analyze data in real-time to identify trends and care gaps.

Squadra structured a digital transformation solution that combined Microsoft platforms with artificial intelligence, eliminating manual processes and delivering a connected, data-driven, and more precise and scalable AI-powered operation.

Genius AI Modernization in action: Agentic Operation

AI is no longer acting in isolation and is now integrated into the operation, connecting data, analysis, triage, and monitoring to support decisions and patient care processes at scale.

The starting point was the elimination of physical forms and the creation of a digital platform accessible even without an internet connection, preparing the operation for structured data capture in the field.

• MS Fabric + OneLake: centralization and structuring of patient data into a unified view, providing a foundation for management, clinical research, and information analysis from multiple sources.

With the structured database, AI was applied in layers that add precision and efficiency to the patient care process, integrating data and image analysis into the operation.

Computer vision and image analysis: AI now supports the visual evaluation of images in real-time, contributing to triage, condition assessment, and results analysis.

• Computer vision for diagnosis: AI now supports the visual evaluation of images in real-time, increasing the speed and consistency of clinical screenings.
  

• Real-time data analysis: Azure OpenAI Service now supports continuous analysis of reports and images, enabling the identification of trends and recurring issues to support the evolution of care.

Faster triage and care: AI now supports visual assessments and information analysis, helping to accelerate patient care.

• Fewer translation errors: digitization and multilingual support reduced translation errors by approximately 90%.

• Faster processes: digitization of forms and the use of Azure AI reduced report generation time from 4-5 hours to 15-20 minutes.

• Fewer recurring medical issues: the organization recorded a 15% reduction, supported by the ability to identify and treat problems with greater accuracy.

• Global recognition: the solution was highlighted as a social impact case on Microsoft's global website, reinforcing the potential of responsible technology and strategic partnership to transform operations at scale.

The innovation, recognized as a social impact case, expanded the organization's care and operational capacity, with a 90% reduction in translation errors, 15% in recurring medical issues, and reports generated up to 95% faster. The collaboration also reinforces the responsible use of AI in a global humanitarian health operation.

Technologies Used