This year, Samsung Electronics’ portfolio of high-performance foldable devices has expanded with the release of both the Galaxy Z Fold3 and the Galaxy Z Flip3. In addition to the Galaxy Z Fold3 with a wider screen, the device has now evolved with the first S Pen with a foldable phone. The addition of this specially designed S Pen allows users to increase their productivity and ensure that they are making the most of every moment.

But Samsung’s advanced new foldable solutions would not have been realized without the hard work and concerted efforts of Samsung’s global network of engineers. Among other things, these collaborators were able to integrate advanced technologies such as AI to enable drawing and writing on the Galaxy Z Fold3’s large screen, as well as enable the device to convert handwriting in different languages ​​into text on the screen. screen with S Pen.

To learn more about the development of the innovative new S Pen, Newsroom spoke with Olga Radyvonenko from the Visual Intelligence Team at Samsung Research Ukraine.

Q: Can you briefly introduce the Ukrainian research institute and the type of work that takes place there?

Artificial intelligence (AI) is one of the key technologies of our R&D center. Our lab is focused on providing Samsung users with human-centric AI technologies that make input and interaction easy and enjoyable.

Q: The S Pen has now been applied to the Galaxy Z Fold3, making it the first of its kind among foldable smartphones. What role did you play in this process?

Our lab’s main contributions to the Z Fold3 have been the development of deep learning technologies on the device for handwriting recognition and the S Pen input latency reduction technology that combines advances in graphics and AI.

Q: What is the S Pen Software Development Kit? What specific benefits does it bring?

The S Pen Software Development Kit (SDK) is being developed by Samsung researchers and developers from many countries around the world, and we are very proud to be part of this international team. The S Pen SDK provides ways to speed up rendering and reduce and optimize the input latency of the S Pen. In addition, it includes smart AI-powered features, such as handwriting recognition, shapes, diagrams and handwriting straightening.

Q: Given the unique feature of the S Pen on the Z Fold3, was there any feature of the S Pen that was developed or expanded specifically for the foldable smartphone?

Because the new Z Fold3 has a huge and unique folding screen, we focused on using our AI technology to optimize the S Pen experience and improve latency. Thanks to our point prediction technology, powered by deep learning, we can predict the next movement of the S Pen to minimize the delay between input and output on the Z Fold3’s screen. This, combined with the front buffer rendering technology and the unique large screen, means that our users can enjoy the most natural handwriting, annotation and drawing on their Z Fold3.

Q: How many languages ​​does the S Pen support now? What were some of the difficulties in expanding the number of recognized languages ​​for the Z Fold3’s S Pen?

At the moment, the S Pen supports a total of 88 languages, of which 14 were newly added in the past year.

Adding a new handwriting recognition language takes a lot of effort. To achieve the world’s best level of recognition quality and speed, we have developed an advanced AI technology. This technology is based on deep learning from millions of user samples and language modeling for natural language processing (NLP).

Q: Do you have any special tips for getting the most out of the S Pen on the Z Fold3 and sharing it with users?

For those who like to write by hand, the S Pen To Text feature now supports writing with the S Pen directly in text fields. The handwriting is then automatically converted to text. You can also edit printed text with your S Pen, such as correcting spaces or inserting words.

One feature that will also interest many users is the Neat Shape mode. It can help you not only draw shapes, but also create a flowchart.

Make sure to check the Tips application and don’t skip any usage tips – there you will discover the latest S Pen and input features, as well as learn how to make the most of many other Samsung apps.

Q: What do you think the future of the S Pen looks like? How could it evolve?

We hope to introduce more ways to support better user experiences in the near future by providing even more personalization. Our mission is to make S Pen input like writing in your notebook with a pen, only better and smarter.

Above all, I want as many people as possible to experience the power and convenience of the S Pen and its handwritten input capabilities. It has the potential to improve input on a wide variety of devices. We see the S Pen not only as a cool gadget, but above all as an accessible and handy tool. I hope to see the S Pen and its features casually used in education, the workplace, and everyday life. I do believe that we will see a revolution in input technology.

The full video of the interview can be viewed here:

This post How the S Pen for Foldable Devices Evolved with AI Technology – Samsung Global Newsroom

was original published at “https://news.samsung.com/global/interview-video-a-collaboration-story-told-by-a-samsung-ukraine-researcher-how-the-s-pen-for-foldables-evolved-with-ai-technology?utm_source=rss&utm_medium=direct”