Secure Hardware and Software for AI systems

ongoing

SHASAI targets the HW/SW security and AI-based high risk systems intersection, aiming to enhance the security, resilience, automated testing, and continuous assessment of AI systems. The rising interest in these systems makes them attractive targets for threat actors due to their complexity and valuable data. Ensuring the security of AI systems involves safeguarding AI models, datasets, dependencies, and securing the underlying HW/SW infrastructure. SHASAI takes a holistic approach of AI system security throughout their lifecycle stages. At requirement definition, SHASAI provides an enhanced risk assessment methodology for secure and safe AI. At design, SHASAI will propose secure and safe design patterns at SW and HW level to achieve trustworthy AI systems. During implementation, SHASAI provides tooling for a secure supply chain of the system by analyzing vulnerabilities in SW / HW dependencies, detecting poisoned data and backdoors in pretrained models, scanning for software vulnerabilities, hardening hardware platforms, and safeguarding intellectual property. At evaluation, SHASAI offers a virtual testing platform with automated attack and defense test suites to assess security against AI and infrastructure-specific threats. In operation, AI-enhanced security services continuously monitor the system, detect anomalies, and mitigate attacks using AI firewalls and attestation methods, ensuring availability and integrity. The feasibility of SHASAI methods and tools will be demonstrated in 3 real scenarios: 1. Agrifood industry: Cutting machines. 2. Health: Eye-tracking systems in augmentative and alternative communication. 3. Automotive: Tele-operated last mile delivery vehicle. Their heterogeneity and complementarity maximize the transferability of solutions. SHASAI will contribute to scientific, techno-economic, and societal impacts as it aligns with the CRA, EU AI Act, NIS2 and CSA, sharing and commercializing methods and tools to ensure trustworthy AI components.