Senior Researcher – Vision-Language Models (VLM)

Huawei Canada has an immediate permanent opening for a Senior Researcher.

About the team:
The Human-Machine Interaction Lab unites global talents to redefine the relationship between humans and technology. Focused on innovation and user-centered design, the lab strives to advance human-computer interaction research. Our team includes researchers, engineers, and designers collaborating across disciplines to develop novel interactive systems, sensing technologies, wearable and IoT systems, human factors, computer vision, and multimodal interfaces. Through high-impact products and cutting-edge research, we aim to enhance user experiences and interactions with technology.

About the job:

• Design, develop, train, evaluate, and optimize advanced Computer Vision, and Machine Learning models, and Vision-Language models (e.g., transformers, multimodal encoders, diffusion models), emphasizing on-device performance and efficiency

• Prototype and optimize SOTA architectures for tasks such as image understanding, visual search, object detection, segmentation, multimodal grounding, etc.

• Implement Computer Vision and Machine Learning algorithms from scratch or leverage existing libraries and frameworks (e.g., TensorFlow, PyTorch, scikit-learn, Keras)

• Explore and apply techniques such as quantization, pruning, distillation, LoRA adapters to meet mobile/embedded constraints

• Choose appropriate algorithms and techniques based on problem requirements, data characteristics, and business needs

• Manage and process large multimodal datasets (images, videos, text)

• Build and maintain data pipelines for model training and inference

• Deploy Machine Learning models to production environments and maintain model retraining and versioning strategies