I currently lead the Ultra-scale AIOps Lab and I take a dual role of Chief Architect and Engineer Manager at the Huawei Munich Research Center in Munich, Germany and Huawei Ireland Research Center in Dublin, Ireland.

You can find more information about our work:

Many of our innovation and system developments is done in collaboration with the Technical University of Berlin and the Huawei-TUB Innovation Lab for AI-driven Autonomous Operations.

Using machine learning and deep learning techniques, we apply AI to various areas related to HUAWEI CLOUD such as: anomaly detection, root cause analysis, failure prediction, reliability and availability, risk estimation and security, network verification, and low-latency object tracking. The areas are categorized in three fields:

  • AI for Operations. We apply analytics and machine learning (ML) techniques to automate IT operations and maintenance. We collect operational data from IT infrastructures, leverage big data and AI platforms to automatically detect and predict failures in datacenters and cloud platforms in real-time.

  • Edge AI. We bring ML algorithms, computation and data storage closer to the devices where data is generated. This local computation allows to process data in devices with a low latency. Examples of use cases include video surveillance and health monitoring.

  • AI for Networks. We leverage ML to automate routine tasks, such as network verification, configuration, optimization and troubleshooting. The new algorithms and tools developed provide network operators and architects with key network insights and actionable information.

  • AI for DevOps. We are also exploring the area of AI for DevOps to determine how AI can be leveraged to improve configuration management, continuous verification, service management, scalability analysis, etc.

Another field of interest is customer intelligence which analyzes the activities and interactions executed by customers when using cloud services. Important types of analysis include usage patterns identification, churn analysis, and automated customer support for diagnose and repair.

AI for Operations

Our current research involves the development of the next generation of AI-driven IT Operations tools and platforms. This field is generally called AIOps (artificial intelligence for IT operations). In planet-scale deployments, the Operation and Maintenance (O&M) of cloud platforms cannot be done any longer manually or simply with off-the-shelf solutions. It requires self-developed automated systems, ideally exploiting the use of AI to provide tools for autonomous cloud operations. Our research looks into how deep learning, machine learning, distributed traces, graph analysis, time-series analysis (sequence analysis), and log analysis can be used to effectively detect and localize anomalous cloud infrastructure behaviours during operations to reduce the workload of human operators. These techniques are typically applied to Big Data coming from microservice observability data.

We create innovative systems for:

  • Service health analysis: Resource utilization (e.g., memory leaks), anomaly detection using KPI and logs
  • Predictive analytics: fault prevention, SW/HW failure prediction
  • Automated recovery: fault localization and recovery
  • Operational risk analysis: CLI command analysis

We are currently developing the iForesight system which is being used to evaluate this new O&M approach. iForesight 5.0 is the result of more than 3 years of R&D with the goal to provide an intelligent new tool aimed at SRE cloud maintenance teams. It enables them to quickly detect, localize and predict anomalies thanks to the use of artificial intelligence when cloud services are slow or unresponsive.

We have already published several papers in this field:

In 2020 we organized an international workshop on AIOps which we plan to repeat in 2021

  • AIOPS 2020 International Workshop on Artificial Intelligence for IT Operations, 18th International Conference on Service Oriented Computing, Dubai Virtual, 14 December 2020.

Edge AI

In recent years, cloud computing has become a central part of the AI evolution. To better address requirements, businesses are becoming aware of the need to bring the technology closer to customers. Thus, Edge AI is emerging as a solution that uses ML to process data generated at the local level. The market is expected to grow in value from $355 million in 2018 to $1.12 trillion by 2023.

Cloud-centric approaches face several limitations such as network latency and bandwidth constraints. While the edge model considerably reduces transmission costs and latency requirements, it raises questions with respect to computational models, system architectures, AI pipelines and reliability concerns. An example of this technology is Amazon Alexa which learns and stores phrases locally using AI. When a user gives a verbal command, the device sends the voice recording to an edge network where it is transformed to text using AI algorithms. Without an edge network, the response time would be seconds, with edge the latency is reduced to <400 ms. As another example, Intelligent EdgeFabric provides a complete edge computing solution, in which cloud applications are extended to the edge. Edge nodes and applications can be managed remotely (e.g., device monitoring, application monitoring, and log collection) and data processed localy. Edge-cloud solutions leverage public cloud infrastructures and edge services.

As a starting point, our project relies on a use case from the field of Smart Logistics and Video Analytics. It involves multi-camera surveillance systems, OCR and real-time object tracking. The cameras monitor containers in a transportation chain, while ML compiles data in real time for the container tracking process. The use case is used to identify new computational models at the edge. It is implemented to demonstrate how edge platforms should be designed to manage AI-driven applications.

To support the reference use case, data needs are collected, stored, processed, analysed, and visualized across the distributed components of edge platforms using AI. The implementation supports training, deployment, and inferencing ML models optimized to provide services with low latency for end users. The output is a set of new computing models, training/inference patterns and libraries/algorithms.

The final system will be used to experiment and evaluate various computational models and architecture configurations, derive latency and bandwidth constraints, and explore how high levels of reliability can be achieved. Afterwards, the findings, namely the new computing models identified, will be translated into new functionalities of the open source software framework Sedna and Kubeedge.

Our approach leverages the following techniques:

Facebook has written a very interesting paper on Understanding Inference at the Edge(slides). The main proposition is that AI models are currently trained in datacenters, but to improve user experience models need to run at the edge. This will enable a lower latency and lower dependency on network connectivity. Vertical integration is key.

Another interesting example of Edge AI (Device AI may be a better term) comes from Google. GBoard is a smartphone keyboard software that does not use centralized retraining of AI models. Instead, smartphones retrain local models and send model changes to a central system. Changes are integrated into a new model which is pushed back to customer devices. This federated learning approach guarantees privacy and a lower power consumption.

We have made the following presentation at KubeCon of our Edge AI system:

AI for Networks

Gartner research indicates that 70% of network operations are still performed manually. Other surveys indicate that misconfigurations are the root cause of 75% of network outages and performance issues. This leads to high MTTR (mean time to resolve) KPIs since problems are only observed in production.

Thus, we are building a network monitoring and verification platform driven by AI for real-time intelligent network verification in cloud datacenters. Our work is related to Google Network Intelligence Center, formal verification at AWS (Security and Reachability), template inference using SelfStarter and active monitoring using Pingmesh, both from Microsoft.

Our approach leverages the following techniques:

  • AI/ML
  • Mixed-integer/constraint programming and SAT constraint solvers
  • Network programmability and programmable switches
  • SmartNICS/FPGAs

As a step in the field of AI for Networks, we are organizing the 1st Network Verification Workshop to provide a forum for the community to come together and rethink fundamental questions, breakthrough solutions in network verification in summer 2021.

AI for DevOps

We have developed an intelligent continuous verification tool to ensure software errors are not transferred to production. If a release verification fails, it is automatically kept out of production by doing a rollback. The tool determines whether or not a release can be pushed to production and requires little-to-no human intervention.

We create innovative systems for:

  • Intelligent coding: logging recommendations, coding efficiency
  • CI/CD: continuous verification, configuration management
  • Real-time debugging: exception management

In this field we have also done some preliminary work on process mining (e.g., Assessing Software Development Teams Efficiency using Process Mining, International Conference on Process Mining, 2019, Germany)

. Bogatinovski, J.; Nedelkoski, S.; Acker, A.; Cardoso, J. and Kao, O. In 30th IEEE/ACM International Conference on Program Comprehension, 2022. [pdf, gs] [bib]

News

Patents

While patents have an increasingly relevant role in innovation, I often find that there is a generalized difficulty in understanding what is patentable and, especially, what makes a patent different from a research paper in the field of computer science. Thus, I prepared a checklist for computer implemented inventions for those writing their first patent.

For those who would like to read more about the topic, the EPO provides an online e-course:

A curiosity about patents. Did you the paper clip has all the ingredients needed for a patent? It was patented in 1897

Open Positions

Thanks for your interest in working with our applied research group at the Huawei Munich Research Center or at the University of Coimbra.

If you are curious about systems, want to be challenged and engage in cutting edge research, propose novel ideas not proposed before, and leave your own mark on the academic world, you are probably a good candidate for a PhD. While a MSc often involves the application of existing models and techniques, a PhD is almost totally independent and involve the creation of novel knowledge not know before.

Our group has a special in interested in the following fields:

  • AI applied to cloud operations (AIOps)
  • Planet-scale cloud and edge computing
  • Machine learning, Deep learning, MLOps
  • Microservices, lambda functions, containers, distributed systems

Our group thrives to see the larger picture, be innovative and creative, and drive to make a lasting impact on planet-scale distributed system design and software systems. We can’t solve problems by using the same kind of thinking we used when we created them – Einstein.

We are always looking forward to work with excellent researchers which:

  • Simplify the complexity of existing technical solutions (KISS principle)
  • Solve difficult technical problems (DIY principle)
  • Focus on the solution, not the obstacle
  • Translate theory into practice

If you need more information explaining what a PhD/MSc thesis is about, you can browse over the following links:

We are also open to host academic visitors (students or faculty).

About me

After ~15 years of working for different industrial and academic research organizations (e.g., SAP Research, The Boeing Company, CCG/Zentrum fur Graphische Datenverarbeitung, KIT, University of Dresden, University of Coimbra), Jorge joined Huawei Munich Research Center as a Chief Architect for Ultra-scale AIOps in April 2015 with the mission of building a new team to develop innovative solutions which explore AI/ML to operate and manage the troubleshooting of HUAWEI CLOUD.

As a strategist, he leads the vision, technical planning and research innovation roadmaps for applied AI to IT operation and maintenance. As a chief architect, he designs and implements AI-driven systems and algorithms. As an engineer manager, he leads 3 teams in the fields of AIOps, Edge AI and AI for Networks.

Jorge enjoys his current role and is always seeking for new technological challenges and breakthroughs in the fields of cloud computing, artificial intelligence and the Internet of Things.

In 2021, he co-founded the Huawei-TUB Innovation Lab for AI-driven Autonomous Operations. Jorge has published over 180 scientific publications in top peer-reviewed conferences and journals in the field of AI for IT operations, distributed systems, workflow management and semantic web (10000+ citations, h-index 45+), and holds 10 patents on related fields. He serves as an associate editor of IEEE Software since 2014. His latest book Fundamentals of Service Systems compiles results from his research work in 2010-2015. He created and led until 2009 the development of the W3C Unified Service Description Language (USDL).

He participated in European, German, US, and National research projects financed by the European Commission (FP7, EACEA), the German Ministry for Education and Research (BMBF), SAP Research (SAP) and Portuguese NSF (FCT). He is a founding member of the IFIP Working Group 12.7 on Social Semantics.

He is also Professor at the University of Coimbra, and affiliated to the Information Systems Group. He has interests in the fields of Cloud Computing, AI, SRE, BPM, Semantic Web, Web Services, and Enterprise Systems (see Google Scholar, DBLP, and LinkedIn)

Jorge received his Ph.D. in Computer Science from the University of Georgia, USA, and B.S. and M.S. degrees with top honors in Informatics Engineering from the University of Coimbra, Portugal.

Random info

I discovered by a random chance my passion in programming and computing when I was 14. My first computer was a Timex Computer 2068 and BASIC was the first language I learned.

Our lab’s culture of innovation and R&D is based on 5 main guiding principles:

A good researcher says, “Lets find out”, others say “Nobody knows”. When a good researcher makes a mistake, he says, I was wrong”, others say “It wasn’t my fault”. A good researcher works harder than others and has more time. Others are always “too busy” to do what is necessary. [Unknown source]

Contact