Title: Displaying Realistic Haptic Feedback on Touch Surfaces Using Machine/Deep Learning

Faculty: Prof. Dr. Cagatay Basdogan (cbasdogan@ku.edu.tr)


Haptics for interactive touch surfaces, also known as surface haptics, is a new area of research in the field of haptics. The goal of surface haptics is to generate tactile effects on touch surfaces such as those used in mobile phones, tablets, kiosks and information displays, and front panels of new generation home appliances and cars. The integration of haptics into touch surfaces will result in new applications in user interface design, online shopping, gaming and entertainment, education, arts, and more. Currently, one of the most promising techniques to generate tactile effects on a touch surface is electrostatic actuation.  When an alternating voltage is applied to the conductive layer of a capacitive touch screen, an attractive electrostatic force is generated in the normal direction between the finger and the surface. By controlling the amplitude, frequency, and waveform of the input voltage, the frictional force between the sliding finger and the touch screen can be modulated. In this context, one important aim is to render realistic virtual textures on touch screens (see the figure below). Texture information on touch screens would improve the user experience in daily activities. For example, feeling the simulated texture of a jean before purchasing it from the Internet would certainly be more motivating for online shoppers. Despite the current advances in hardware, tactile rendering algorithms have yet to reach the realism necessary to simulate a wide range of textures due to variations in their a) physical attributes (e.g. roughness, kurtosis, skewness, etc.), b) psychological attributes (e.g. fine, course, smooth, sticky, etc.) and c) affective attributes (e.g. cool, wavy, granular, repetitive, elegant, etc.). The post-doctoral fellow is expected to design experiments to collect data from real textured surfaces and develop machine/deep learning algorithms to generate their virtual counterparts by establishing the links between those attributes. She/he is expected to have research experience in human-computer interaction, surface haptics, texture modeling, and rendering, and machine/deep learning with a background in CS, EE, or ME.

Grooves and ridges of a real grating can be rendered as high and low friction regimes in the corresponding virtual grating, respectively. Finger penetrates into the real grating but not the virtual grating since the grating height cannot be rendered explicitly by electro vibration since it modulates the tangential friction force only.

Some Related References:

  1. Basdogan, C., Giraud, F., Levesque, V., Choi, S., 2020, “A Review of Surface Haptics: Enabling Tactile Effects on Touch Surfaces”, IEEE Transactions on Haptics, DOI:10.1109/TOH.2020.2990712.
  2. Basdogan, C., Alipour S. M., Sirin, O., 2020, “Modeling Sliding Friction Between Human Finger and Touchscreen Under Electroadhesion”, IEEE Transactions on Haptics, DOI: 10.1109/TOH.2020.2989221.
  3. Ozdamar, I., Alipour S. M., Delhaye, B. P., Lefèvre, P., Basdogan, C., 2020, “Step-Change in Friction under Electrovibration”, IEEE Transactions on Haptics, Vol. 13, No. 1, pp. 137-143.
  4. Isleyen, A., Vardar, Y., Basdogan, C., 2020, “Tactile Roughness Perception of Virtual gratings by Electrovibration”, IEEE Transactions on Haptics, DOI: 10.1109/TOH.2019.2959993.
  5. Sadia, B., Emgin, S.E., Sezgin, T.M., Basdogan, C., 2020, Data-Driven Vibrotactile Rendering of Digital Buttons on Touchscreens, International Journal of Human-Computer Studies,Vol. 135, 102363.
  6. Sirin, O., Barrea, A., Lefevre, P., Thonnard, J-L, Basdogan, C., 2019, “Fingerpad Contact Evolution Under Electrovibration”, J.R. Soc. Interface, Vol.16, No. 156, 20190166.
  7. Senem, E.E., Aghakhani, A., Sezgin T.M., Basdogan, C., 2019, “HapTable: An Interactive Tabletop Providing Online Haptic Feedback for Touch Gestures”, IEEE Transactions on Visualization and Computer Graphics, Vol. 25, No. 9, pp. 2749-2762.
  8. Ayyildiz, M., Scaraggi, M., Sirin, O., Basdogan, C., Persson, B.N.J., 2018, “Contact Mechanics Between the Human Finger and a Touchscreen Under Electroadhesion”, Proceedings of the National Academy of Sciences of the United States of America (PNAS), Vol. 115, No. 50, pp. 12668-12673.
  9. Vardar, Y., Guclu, B., Basdogan, C., 2017, “Effect of Waveform on Tactile Perception by Electrovibration Displayed on Touch Screens”, IEEE Transactions on Haptics, Vol. 10, No. 4, pp. 488-499.