This course presents tools for developing 2D interactive applications: Qt GUI toolkit (in C++), Android user interfaces on mobile devices, Web interface basics.See also: TP-INF203 (Web development), TP-INF224 (Programming), TP-IGR203 (Human-Computer Interaction).

This course presents methods and techniques for designing efficient, user-friendly user interfaces. Focuses on software development (GUI toolkits, Web interfaces, Statecharts, MVC, multi-threading) and on human factors (user-centered design, evaluation, ergonomics, empirical laws and models). Also presents novel emerging techniques

The goals of this course are: To introduce the fundamental principles of visualization; To give an overview of existing visualization techniques and systems; To understand how to critique visualization techniques for a particular kind of data for a particular task; To learn how to evaluate visualization systems; To provide the foundation necessary to create new visualization tools.

Online versus services. Peer-to-peer versus Client-Server. Communications. Generalization of Game-Loop. Middlewares for online. Server-side architecture. Message-Oriented Middlewares for services. Notes: 1) The courses and labs will take place in a room in Palaiseau; 2) Students will have to bring their own laptop for the different labs of the course.

This class will propose an in-depth presentation of the main approaches used in current video games to handle decision making of autonomous, and possibly, collaborating agents . The course will cover the “classical” algorithmic-based AI approaches with a general focus on interactive and real-time constraints , ranging from decision and behavior tree, rules based methods and inference system, as well as hierarchical system for distributed communication and cooperative behaviors. Note: This course is heavily oriented toward application and programming, much more than its theory. Lab classes are used for a collaborative project developed in C++ with the Starcarft API. Good skills in C++ are required. Warning: Strict numerus clausus to be respected depending on the number of place left. Please contact the professors and your tutor before confirming your enrolment.

The goal of this course is to learn how to use gestures as an effective input modality in interfaces including small-screens, touch screens, mobile devices and interactive systems based on expressive nonverbal whole-body communication. This course presents some techniques for capture, recognition and interpretation of gestures.

Advanced user interface programming techniques.architecture and algorithmic underpinnings of UI toolkits.how to create user interfaces, including how to extend standard widgets and move beyond WIMP to off-the-desktop contexts.

Interaction styles, basic elements of psychology and software engineering for HCI, in-depth analysis of graphical interaction,post-WIMP interaction techniques, conceptual modeling, theories and models for HCI.

Introduction to the different methods for evaluating interactive systems. By the end of this class, students shouldbe able to identify the right evaluation method to consider depending on the type of users, the type of the systemand design stage of the system

Groupware and mediated interaction, including a state-of-the-art of interactive systems for coordination,communication and collaboration with groups of users across time and space. Also covers Collaborative Virtual Environments,social networks and crowdsourcing.

Physical representations of data pre-exist with the invention of the written language. While our contemporary notion of data did not yet exist, early humans externalized their memory by encoding quantitative or qualitative values into physical objects. Over the following millennia, physical data representations allowed people to record, reflect, reason, and decide about the world in new and profound ways.Creating data objects is far from a lost art, and an explosion of new fabrication technologies also introduced an ever-wider array of physical tools to support thinking and communication. We are now in an era where data is an increasingly visible part of our everyday existence, a growing number of artists, designers, makers, and everyday people are actively exploring the possibilities of making data physical.This class will provide the student the occasion to reflect on how data could be encoded and manipulated in physical objects. This class will cover first a short historical introduction, second some snapshots of the practices used by contemporary designers, and some design considerations. The main focus of the class will be to create a physical object to either encode data during a collective action or to represent an existing dataset.This class will be based on the recently published book “Making with Data” (https://makingwithdata.org/).

Quant UX, or Quantitative User Experience (research) is an emerging field with strong industry applications, that applies quantitative methodologies (statistics, data-science) to understand how users interact with digital systems, to find bottlenecks and make better decisions. The increasing integration of a digital layer in all facets of everyday life, from professional to personal, makes it essential to consider how diverse groups of end-users are interacting with digital systems. The majority of digital systems from websites to apps, are registering data on user-interactions which can be analyzed systematically to understand how users interact with an interface, where they encounter bottlenecks, and where there are opportunities for improvement. These include surveys, A/B testing, analysis of data logs, as well as psychophysiological methods like eye-tracking and others. Importantly, the aim of these methods is not stop at analysis, but needs to be linked with actionable insights and innovations.

This course will provide an introduction to key theoretical concepts and methodological approaches of Quant UX. The course will be hands-on. Students will work in small groups to analyse a proposed dataset or one they collect themselves. Different stages of the workflow will be explored each week (UX dimensions, problem definition, data analysis, iteration, testing, insights).

In this course, through a practice-based approach, lectures, step-by-step instructions and exercises, students will learn multiples design and sketching methods. These methods are useful to design, express, refine, present and discuss your (and others’) design ideas about user experiences, service design and application design. This course will help you to build (1) a culture of experience-based design (2) skills to better express your design of a service, a system and application graphically. [b]

In this workshop, students will collectively and intensively explore a research question around the appropriation, uses, symbolics of a real space.. Based on a collaboration with a field of study, they will structure a research question, design the appropriate research methods, apply empirical methods, analyze and present their results. The goal of the course is to experience a short research process from the beginning to the end, to experiment with empirical methods related to human behavior, and to collaborate with (institutional) actors on original fields.

Contemporary projections on possible futures are paradoxical, on one side transhumanism, on the other side collapsology, between the two climate changes. On the one hand, there is an injunction to the energy transition, on the other hand, an injunction to the ecological transition, and between the two, a questioning of their compatibility. How can we study and graphically represent all the scenarios that make up our future projections?This workshop is dedicated to this question and will take place in three parts: 1) theory of visual mapping, 2) conferences on futures, 3) design of a map of possible futures. The theoretical part will be composed of lectures on the principles of graphical data analysis, on temporal data visualization, and a quick overview of data visualization tools. This is followed by a series of lectures by researchers interested in prospecting, speculative design, and analysis of futuristic scenarios. Following these theoretical content, you will be supervised to collectively create a map of possible futures, based on your own cultural or scientific references. This workshop will allow participants to acquire a basic knowledge of graphic data representation methods, and will also provide a space to discuss and debate different prospective scenarios and to design new graphic representations dedicated to this issue.[d]

In this research seminar, scholars and practitioners in Design, Human Factors and HCI are invited to present their late-breaking works, and to discuss with students and labs’ researchers.

The integration of a user-centred reflection at the heart of the approach is a key element for the success of design projects. To improve the relevance and effectiveness of new products and services, it is necessary to take into account the contexts of use, social acceptability and appropriation of new technologies that are at the heart of innovation. This course will aim to familiarize you with different concepts related to the user experience, with design criteria, as well as with different user integration approaches, developed in design ergonomics.

In addition, the course will focus on Design Thinking methods, which distinguish between the "empathize-define-ideate-prototype-test" phases. Different techniques and methods will be presented to you for each phase, which you can experiment on design cases. Particular emphasis will be placed on the role of low-tech sketching and prototyping in the ideation and evaluation of design proposals. To take this course, you do not need to be able to draw, but it is highly recommended to think about a problem, or a project to design during the course.

This course first gives an overview of the field of data visualization. It then discusses fundamental principles of human visual perception, focusing on how they help inform the design of visualizations. The following sessions focus on visualization techniques for specific data structures, and discuss them in depth from both design and implementation perspectives, including: multi-variate data, hierarchical structures, networks, time-series, statistical data and geographical data. All exercises are based on Web technologies, including the D3 software library (Data-Driven Documents) and the Vega-lite interactive graphics grammar.

This UE presents an introduction to Augmented/Virtual and Mixed Reality challenges from an Human-Computer Interaction Perspective. The class covers an introduction to fundamental concepts of AR/VR/MR and presents methods and techniques allowing to design and implement interactive applications. The class is accompanied by a practical hands-on implementation and evaluation of a Virtual Reality application developed in Unity3D.
The class covers the following topics: History of AR/VR, Current technology enabling AR/VR and Human Perception, Challenge of Input, Challenge of Haptics, Interaction Design for AR/VR, Application Scenarios for AR/VR, Current Research Problems and Challenges from CHI, UIST, IEEE VR, ISMAR, SIGGRAPH.

Aims to give students the knowledge needed to conduct research and/or advanced developmentin the field of Virtual and Mixed Reality, including Augmented Reality or Augmented Virtuality.Lectures are combined with Tutorials (TD) to directly apply conceptual and research issuesto the most recent technologies and software in V&MR. Also covers the human factors impacted by the use of V&MR technologies.

Covers the topic of mixed reality and augmented reality systems and of tangible interaction.Presents a combination of techniques and devices to help augment the environment

Main areas of research in modeling, animating, and rendering realistic and expressive autonomous virtual humans.

Introduction to computer graphics for 3D application development: basics of rendering pipeline, transformations, camera models, shading models, and graphics programming using OpenGL and C/C++

Theoretical and practical concepts of 3D computer graphics and its applications in virtual reality: shape modeling, image synthesis, geometric processing and analysis, computational geometry, computer animation and simulation, interactive 3D applications

Advanced areas of 3D computer graphics with particular emphasis on geometric modeling with 3D surface meshes, realistic image synthesis, real-time rendering for video games, and simulations for special effects (e.g., deformable objects and fluids).

Course presenting 3D computer Animation and Simulation methods for real time and interactive Graphics applications. Topics: Interactive deformations of 3D surfaces and volumes, Virtual character animation, Physically-based simulation to interact with solid and deformable objects: Collision and interaction between elastic and plastic shapes, cloth simulation, fluid simulation (particles based and grid based). The course focusses on methods typically used in entertainment applications (Computer Games, VFX, Animation Cinema, Virtual Reality, etc). Type of class: Mostly applied class with practical computer implementation - each topic is associated with a dedicated implementation to be developed in the computer lab classes. Programming language: C++.

Introduction to image processing and computer vision: image representation, edge detection, segmentation, retargeting, filtering, etc. This course presents classical approaches of computer vision and object detection: feature extractions, classification; as well as an introduction to recent classification methods based on deep convolutional networks.
Programming language: Python.

This course will introduce the fundamental concepts for creating and analyzing shapes on the computer. We will start with generating and representing smooth curves in 2d using splines and Bézier curves. We will then move to various techniques for shape representation in 3d with special emphasis on triangle meshes and associated methods. At the same time, we will introduce methods for shape *analysis* and in particular defining and computing similarity between shapes, and shape matching (establishing correspondences between points on shapes).
Programming language: C++.

This course presents the principles, algorithms and techniques of image synthesis. It deals in particular with digital models of shape, appearance, lighting and sensors present in a 3D scene. The rendering equation, as well as standard illumination, shading and reflectance models are presented. Various rendering algorithms based on these models are detailed, including rasterization (projective rendering) and ray tracing. Real-time rendering, GPU programming and hierarchical spatial data structures are also covered. Finally, an opening towards global illumination concludes the course.
Programming language: C++.

This course is a walk through computational geometry problems: a young discipline of computer science that studies from a combinatorial and algorithmic point of view the properties of geometric objects such as point clouds, arrangements, geometric graphs, or even triangulation. Examples of such problems are convex envelopes, Delaunay triangulation, point cloud reconstruction, approximation of NP-complete geometric, or the efficient location of points in large dimensions.
Programming language: C++.

This research-oriented course explores the links between Artificial Intelligence and Computer Graphics, with two main topics:
Creative AI (also called “expressive” 3D modeling): In the context of the interactive creation of virtual worlds, we will explore creativity enhancement through the combination of knowledge-based models, light learning from examples, and intuitive interfaces based on sketching, painting or sculpting gestures.
Character animation: We will study the combination of knowledge-based models and machine learning techniques for planning motion of both individual characters and groups, as well as to generate the final animations, from layered models for skin and floating parts to controllers enabling physically-based characters to make the best use of their muscles over time.
Lab programming language: C# with Unity. Labs based on project mixing machine learning with graphics in Unity.

Human communication is multimodal per se, that is human effectively communicate meaning, feelings and emotions through multiple sensory channels such as speech, movement, and facial expressions. A lot of effort has been devoted to conceive intelligent machines able to capture, represent, and automatically analyze the multimodal behavior of their users in order to engage them in a multimodal dialog aimed at establishing a natural interaction. This course provides students with foundational conceptual knowledge, methodologies, and tools for designing, implementing, and evaluating such kind of intelligent machines.

This course will present some basic learning algorithms (linear regression, logistic regression, SVM, Bayesian Networks, etc.). Students will have the chance to implement and try some of these algorithms on simple examples. Very wide application fields in robotics and social robotics will be presented.

Introductory level class on Machine Learning on generic data: Supervised Learning, Unsupervised Learning, Kernels, Neural Networks, Basics of Deep learning and Graph neural network.

This course introduces students to the advanced principles of Deep Learning, including mathematical foundations, architecture design and practical applications. This course is particularly relevant given the current state of the job market, where Deep Learning skills are in high demand in many sectors, including technology, finance, healthcare and entertainment. The class include the following topics: GAN, Attention and Trasnformers, Graph Neural Networks, Neural architect search, and various interdisciplinary applications: Large Pretrained Models, Vision & Language, Biological Applications, Time Series.

This course selects a number of advanced topics to explore in machine learning and autonomous agents, in particular: Probabilistic graphicsal models (Bayesian networks), Multi-output and structured-output prediction problems, deep-learning architectures, Methods of search and optimization, Sequential prediction and decision making, Reinforcement learning.

Presents main concepts, mechanisms and difficulties of current programming languages, which are illustrated in C++11 and Java. Also provides an introduction to Java Swing and event programming. A large part is devoted to practical work. Topics: programming paradigms, object-oriented programming, polymorphism, generic programming, lambdas, memory management, pointers and references, constness, graphical user interfaces, event management, MVC.

Same course as TP-INF224a but in Period 2.

This course presents methods and techniques for developing dynamic, modern, robust, safe websites. Topics: Internet and the Web, basic Web languages (HTML, CSS, JavaScript), rich dynamic content, server-side programming and frameworks, client-side and AJAX frameworks, website security.

Principles, Protocols and advanced techniques for Audio-Visual content delivery. Associated Web Technologies: HTML5 video, Media Source Extension, Encrypted Media Extension, XHR/Fetch

Project in HCI or in Graphics

This module allows students to experience and be involved in ongoing research projects inside of teams of IP Paris. It is the students responsibility to contact a researcher in their field of interest beforehand and ask about the possibility and scope of such a project before enrolling in this module! If both agree on a project, the student can enroll in the module and will be provided a grade at the end of the second period.
The goal of the project is to involve students that are interested in research in ongoing research projects of the individual team. This can be in the form of an individual research project of the student in collaboration with a supervisor, or involving the student as part of a contributor inside an already going research project. The ideal goal should be to create or contribute to a scientific publication. However, the type of deliverables at the end of the project (e.g., source code, documentation, data set) will be defined with the supervisor of the project beforehand and can vary from research project and team.
The course ends with a presentation of the students contribution to the research project inside of the individual team (either as part of a research meeting or as a dedicated event). The supervisor of the project is in charge of evaluating the quality of the outcome and providing a grade and its justification to the student in form of a short paragraph, describing the quality of the work and potential fields of improvement for the future.

Same as TP-IGD900 but longer and during Semester 2.