Teen-designed tech could expand access for people with disabilities – Science News for Students
Millions of people around the world are affected by visual and hearing impairments. For many of them, access still remains an issue. Teens at the 2022 Regeneron ISEF competition presented new technology to address such barriers.
Richard Hutchings/Corbis Documentary/Getty Images Plus
By
ATLANTA, Ga. — While procrastinating on homework, Seoyoung Jun closed one eye and successfully picked up her pencil holder. She realized that orienting herself in a 3-D space didn’t require both eyes. This surprised her. With research, she learned that the brain can process 3-D information without any vision at all. And with that, the idea for Mind Beacon was born.
Visually-impaired people get their spatial information mainly from touch, not vision. And this sophomore at Thomas Jefferson High School for Science and Technology in Alexandria, Va., based her new navigation device on that idea. It can help blind people get a read on what obstacles lay ahead.
The portable device uses a beam of infrared light to gather 3-D information about the placement of walls, beams, furniture and other things. The bounced beam conveys that information back to the device, which then raises little pins to indicate where those obstacles are. People who are visually impaired can “read” the position of those pins to understand the layout of structures and objects ahead — and navigate around them.
When Seoyoung’s device worked for the first time, she didn’t believe it. She’d been up all night working on it. To be sure it wasn’t a mistake, she shut it off and rebooted. When it worked again, she recalls, “I just started screaming [with joy].” It had been seven long months of research, building and testing. Her excitement woke her parents, who asked her to please pipe down. So she jotted down some notes and then, finally, went to sleep.
This portable device to help visually-impaired people create a mental image of their surroundings won the 16-year-old a spot at the world’s premier high-school research competition. She joined some 1,750 other finalists, last week, at the 2022 Regeneron International Science and Engineering Fair. Roughly 600 of those teens shared nearly $8 million in prizes.
A number of those finalists wowed judges and members of the public with new tech to assist people with sensory disabilities.
The heart of Mind Beacon is a 3-D depth sensor that’s hooked up to a mini computer. Seoyoung coded that computer to control nine motors that are lined up in three rows of three. Each motor controls a pin that can move up and down. The height of each pin conveys data on 2.25 cubic feet (0.06 cubic meter) of space in front of the sensor. On the computer screen, those nine blocks of space represent “volume boxes.” Together, they look something like a 3-D strike box in baseball.
The idea for the display was inspired by her brother playing Minecraft, Seoyoung explains. That computer game uses “multiple cubes put together,” she says. She realized that would be a good way to depict spatial data in real life.
When the sensor detects an obstacle in a volume box, the corresponding pin rises. It can rise to three different heights. Each height roughly denotes the height of the obstacle. Someone who runs their hand over the nine pins can tell where the obstacles are and their general height. To increase the display area even more, Seoyoung added a zoom lever. It relays data from volume boxes that are even farther away.
She imagines a future version that could hook up to a smartphone, with more little pins that can mimic the exact height of obstacles. It would feel like a little map depicting the location and size of obstacles ahead.
Seoyoung’s work took second place in the fair’s Robotics and Intelligent Machines category. That award came with a $2,000 prize.
As a coder, Nand Vinchhi wanted to invent something that didn’t require a device. While brainstorming with friends at a hackathon, the group came up with the idea for a platform to translate sign language. In the end, the team decided not to develop it. But Nand couldn’t stop thinking about the translator.
“I’ve always been super interested in a better education system for everyone, especially in my country,” where there’s a lot of inequality, he says. This 17-year-old attends the National Public School, Koramangala in Bangalore, India. “I wanted to do something through technology that would help.”
In just a few months, he developed the artificial-intelligence technology needed to translate American Sign Language (ASL) in real-time. It’s basically a speech-to-text app for sign language. Here, hand movements are the speech.
The hardest part, Nand says, was figuring how to approach the problem. At times, he says, “I didn’t know what to do.” When that happened, he would go to sleep. “In the morning, I tried again.”
For Nand, “sleeping on it” paid off. He decided to pinpoint body parts important in signing. This might be individual fingertips, for instance. Using a machine-learning program, he then taught a computer to identify those key points in videos he took. The computer would compile data from many frames of the video. This created a dataset.
Nand gathered lots of these datasets and then used an algorithm to look for differences between them. That allowed him to compare a sign to any of some 100 ASL words in that dataset.
His system now translates signs with 90.4 percent accuracy, he reported at the competition. The delay from signing to translation is only about three-tenths of a second. That’s only a tenth of a second longer than the typical speech delay in video calls. The teen now plans to boost the accuracy and words available in the dataset.
Nand imagines the technology could be integrated someday into existing communication platforms, such as Zoom, or into online platforms such as Google Translate. That could help ASL speakers communicate with those who don’t know the language. Another promising application, he thinks, is as an education tool for people who want to learn ASL, he says — such as Duolingo.
Weekly updates to help you use Science News for Students in the learning environment
Thank you for signing up!
There was a problem signing you up.
Sisters Shanttale and Sharlotte Aquino Lopez worked on a related communications problem. But these engineers from the San Juan Math, Science and Technology Center in San Juan, Puerto Rico took a totally different approach. Shanttale, 18, and Sharlotte, 16, wanted to help break the barrier between those who use ASL and those who don’t know it. The glove they developed can help anyone learn basic ASL.
Sensors they put on fingers of the glove relay motion data that reflect the shape of the glove. The glove then conveys those signals to a circuit board, which translated the input into a letter on a screen. The idea is that the glove can help users visualize the signs they’re learning. In time, users should be able to understand ASL as signed by others — and “speak” it themselves.
Fifteen-year-old Joud Eldeeb built a shoe for visually-impaired people. This young engineer attends Haitham Samy Hamad in Damanhur, Egypt. She embedded sensors in the footwear that vibrate, ding and send a text to alert the wearer of upcoming obstacles.
What these projects all have in common is a creative new use of computer technology to make the world more accessible to people with disabilities. Computer programming is the future, says Joud. “I want to learn it to help the world.”
3-D: Short for three-dimensional. This term is an adjective for something that has features that can be described in three dimensions — height, width and length.
algorithm: A group of rules or procedures for solving a problem in a series of steps. Algorithms are used in mathematics and in computer programs for figuring out solutions.
American Sign Language: A way of communicating using hand shapes and body movements.
artificial intelligence: A type of knowledge-based decision-making exhibited by machines or computers. The term also refers to the field of study in which scientists try to create machines or computer software capable of intelligent behavior.
code: (in computing) To use special language to write or revise a program that makes a computer do something. (n.) Code also refers to each of the particular parts of that programming that instructs a computer’s operations.
compile: To assemble information from different places, sources or times and use them to make something new (such as a list or report). (in computer science) To translate a computer program’s output into machine code or some series of steps that will operate a device or simpler computer program.
computer program: A set of instructions that a computer uses to perform some analysis or computation. The writing of these instructions is known as computer programming.
data: Facts and/or statistics collected together for analysis but not necessarily organized in a way that gives them meaning. For digital information (the type stored by computers), those data typically are numbers stored in a binary code, portrayed as strings of zeros and ones.
develop: To emerge or to make come into being, either naturally or through human intervention, such as by manufacturing. (in biology) To grow as an organism from conception through adulthood, often undergoing changes in chemistry, size, mental maturity or sometimes even shape. (as with towns) The conversion of wildland to host communities of people. This development can include the building of roads, homes, stores, schools and more. Usually, trees and grasslands are cut down and replaced with structures or landscaped yards and parks.
engineer: A person who uses science to solve problems. As a verb, to engineer means to design a device, material or process that will solve some problem or unmet need. (v.) To perform these tasks, or the name for a person who performs such tasks.
engineering: The field of research that uses math and science to solve practical problems.
high school: A designation for grades nine through 12 in the U.S. system of compulsory public education. High-school graduates may apply to colleges for further, advanced education.
infrared: A type of electromagnetic radiation invisible to the human eye. The name incorporates a Latin term and means “below red.” Infrared light has wavelengths longer than those visible to humans. Other invisible wavelengths include X-rays, radio waves and microwaves. Infrared light tends to record the heat signature of an object or environment.
intelligence: The ability to collect and apply knowledge and skills.
lever: A rigid bar resting on a pivot. It is used to help move a heavy or firmly fixed load with one end when pressure is applied to the other.
motor: A device that converts electricity into mechanical motion. (in biology) A term referring to movement.
navigate: To find one’s way through a landscape using visual cues, sensory information (like scents), magnetic information (like an internal compass) or other techniques.
programming: (in computing) To use a computer language to write or revise a set of instructions that makes a computer do something. The set of instructions that does this is known as a computer program. The term is also used, in an analogy to computer programming, to describe the way something — such as cells — have been designed to function. A person who writes or revises software is a known as a programmer.
prototype: A first or early model of some device, system or product that still needs to be perfected.
real time: A term that connotes immediacy; something is being studied, recorded and/or reported at the very time it is happening.
recall: To remember.
Regeneron International Science and Engineering Fair: (Regeneron ISEF) Initially launched in 1950, this competition is one of three created (and still run) by the Society for Science. Each year now, approximately 1,800 high school students from more than 70 countries, regions, and territories are awarded the opportunity to showcase their independent research at Regeneron ISEF and to compete for an average of almost $8 million in prizes.
sensor: A device that picks up information on physical or chemical conditions — such as temperature, barometric pressure, salinity, humidity, pH, light intensity or radiation — and stores or broadcasts that information. Scientists and engineers often rely on sensors to inform them of conditions that may change over time or that exist far from where a researcher can measure them directly. (in biology) The structure that an organism uses to sense attributes of its environment, such as heat, winds, chemicals, moisture, trauma or an attack by predators.
smartphone: A cell (or mobile) phone that can perform a host of functions, including search for information on the internet.
spatial: An adjective for things having to do with the space where something is located or the relationships in space between two or more objects.
strike: (in baseball) Any of three situations: A swing that misses the ball, a hit that flies into foul territory or a pitch that isn’t swung at but passes over home plate in an area described as a “strike zone” (a region that runs between the batter’s chest and knees).
system: A network of parts that together work to achieve some function. For instance, the blood, vessels and heart are primary components of the human body’s circulatory system. Similarly, trains, platforms, tracks, roadway signals and overpasses are among the potential components of a nation’s railway system. System can even be applied to the processes or ideas that are part of some method or ordered set of procedures for getting a task done.technology: The application of scientific knowledge for practical purposes, especially in industry — or the devices, processes and systems that result from those efforts.
Anna Gibbs is the spring 2022 science writing intern at Science News. She holds a B.A. in English from Harvard College.
Free educator resources are available for this article. Register to access:
Already Registered? Enter your e-mail address above.
Readability Score: 7.9
HS-ETS1-1, HS-ETS1-4, MS-ETS1-1, MS-ETS1-3
Founded in 2003, Science News for Students is a free, award-winning online publication dedicated to providing age-appropriate science news to learners, parents and educators. The publication, as well as Science News magazine, are published by the Society for Science, a nonprofit 501(c)(3) membership organization dedicated to public engagement in scientific research and education.
© Society for Science & the Public 2000–2022. All rights reserved.