EGYPTIAN-AMERICAN: AI Captain! Rana El Kaliouby’s bold trek to the final frontier of Humanising Technology

Egyptian-American founder of Affectiva is on a mission to revolutionise the way we connect with our digital devices, and each other, by building in emotional intelligence.

The earliest memory that Rana El Kaliouby can conjure is of standing on a tiny blue plastic chair in a romper suit confidently declaring whatever was on her toddler mind at the time.

She is about three years old, revelling in her father’s attention as he dispenses tips – “look at the audience, enunciate your words” – and records the ramblings for posterity with the first commercially available home video camera.

These regular living room sessions led to El Kaliouby going on to give many accomplished public-speaking performances around the world as an artificial intelligence scientist and entrepreneur, most recently this month at the CogX Festival Deep Tech Summit in London.

Her big message after decades working in technology is that the final frontier lies at the point where AI can be immersed in emotional intelligence , or EI, to revolutionise the human-to-computer experience.

But it’s obvious that the first seeds of that life-fulfilling mission were sown more than 40 years ago in her childhood home in Kuwait where she was first encouraged to get to grips with ideas and machines.

“Our family is really big on education, the thing my parents invested in me and my sisters,” El Kaliouby, 45, tells The National.

“And because they were both in tech, we were always exposed to the latest and greatest gadgets. I was a big Atari game player,” she adds, laughing.

El Kaliouby looks back fondly on those clunky old VHS cassettes and hours the family spent playing Pac-Man as examples of the positive way in which electronic devices can bring loved ones together.

Less happy interactions with latter-day technology, however, brought about the realisation that something was missing – all the rich communication signals provided by non-verbal cues were being lost.

An enterprising mission

Her focus ever since has been on developing artificial intelligence that recognises facial expressions so that people can have better connections with their laptops, and, crucially, with each other.

Born in Egypt after her tech guru father, Ayman, met his future wife, Randa Sabry, on a university campus, it seems almost inevitable that El Kaliouby grew up to be a proud geek pursuing a career in computer science.

“It’s a cute story,” she says. “My dad was teaching COBOL programming, this obsolete language that nobody uses any more but was the programming language in the 70s.

“My mum, who was a business major, decided to explore this thing called computer science, and he was kind of interested in going out with her. She said, ‘I don’t do that. No dating allowed.’ And he was like: ‘Ok, then I’ll propose.’”

Soon after, the newlyweds moved to Kuwait, and her mother became one of the first female computer programmers in the Middle East, until having to flee when Saddam Hussein invaded.

Aiming for the stars

Next stop was Abu Dhabi, where El Kaliouby’s Muslim-Arab upbringing was conventional in many ways, bounded by “lots and lots” of rules that included not making any boy friends while at school.

“I always imagined walking around with a gold star on my forehead. I was a very nice, rule-abiding daughter. I stuck to the strict curfews. I never dated through high school or college and I think, by and large, I was always an A student.

“But, at the same time, it was very empowering. I have two younger sisters and the message was always: ‘You can do anything you want in the world.’”

She continued to meet these expectations into her early 20s, earning undergraduate and master’s degrees in Computer Science at the American University in Cairo, and marrying the founder of a start-up, Wael Amin.

Within a year, though, El Kaliouby was undertaking a PhD 5,000km away at Cambridge University despite both sets of parents saying: “Wait a second, you’re married now and you can’t leave.”

Amin, she says, deserves the credit for supporting her daring dream and agreeing to a long-distance relationship.

“It was really unheard of. I did break rules more as an adult as I explored my passions and my quest for being a researcher and an entrepreneur.

“That’s how I think I pushed the boundaries and definitely made my parents uncomfortable.”

And then? “I like the wording that my life went off the rails. I think that kind of encapsulates it.

“Cambridge opened my horizons. It’s like I discovered the world and it was hard to unlearn that.”

The enthusiasm for her life’s work comes across even through the medium of our Zoom interview, but it’s also clear that this was not an easy time.

El Kaliouby arrived in England a few days after the September 11, 2001 attack in America, a young Arab woman then wearing a hijab.

“I was visibly Muslim. My parents were very concerned about my safety.”

The perpetual smile she adopted by way of a peace offering was also something of a mask, hiding the loneliness and separation from those she loved.

Back then, the technological means for staying in contact across the distance was largely restricted to the kind of messaging that proved a barrier to expressing true feelings, making El Kaliouby all the more determined to humanise technology.

“My PhD was centred around building a machine with emotional artificial intelligence, and I recognised at the time that a lot of the ways I was communicating with my family back home, and especially my husband, was through chat.

“We didn’t have video communication and it was certainly very expensive to make phone calls so we would use texting.

“I often felt I could hide my emotions behind the machine. There were many days where I would be homesick or even in tears, but I’d never communicate that. The best I could do was send a sad face emoji.”

The personal hardships became a driving force for her work. In a career paved with “what if” moments, El Kaliouby began to ask: “What if we could teach technology to understand us in the same way that we understand each other?”

“It’s not even in the choice of words we use. It’s our vocal intonations, our facial expressions, our body posture – and all of that was just getting lost via digitally mediated communications.”

Life was about to take another decisive twist as she received an email that the scientist, inventor and entrepreneur Professor Rosalind Picard was coming to give a talk on campus.

El Kaliouby had long been an admirer of this trailblazing woman in an almost overwhelmingly male-led field, whose book on designing computers to recognise human emotions she read while still in Cairo.

Life-changing encounter

“I often say this is the moment that changed the trajectory of my life,” she says of Picard’s request to meet some of the students.

So impressed was Picard by this intense young woman that she offered El Kaliouby a post-doctorate place on the Affective Computing Research Group at the Massachusetts Institute of Technology Media Lab before their first 20-minute conversation had ended.

“I remember thinking, ‘But I need to go back to Egypt. I have this husband waiting for me.’ And she basically said, ‘Just commute from Cairo. Show up whenever you want to.’’’

By then, El Kaliouby had a daughter, Jana, born in the UK, and a son, Adam, arrived in that other Cambridge in the US, but the constant round trips were becoming unsustainable.

“I was just doing that crazy back and forth. I would say it was OK until it went insanely chaotic when I started the company.”

The company was Affectiva, founded with Picard in 2009 with the goal of creating a commercial applications of emotion-sensing AI.

Growth was fast and it was an exciting time but there was another, darker side. “I was travelling so much, there was very little presence in anything I did,” El Kaliouby says.

Big lesson learnt

“I feel like I was out of balance. I didn’t make any time to sleep well. I would wake up at three in the morning almost every day and fire all these emails to my team. And so these poor people would wake up at six or seven in the morning with a whole slew of notes from me.

“I would go on vacation with my husband and my two young kids, and I’d just be on call all the time. There were zero boundaries, zero balance, and that was a big lesson learnt. There’s always time for self-care. There should always be time to spend with family and loved ones and friends. And, I didn’t do that, you know?”

By 2016, she was a divorced mother of two young children living full-time in America, and decided to bare that vulnerability in her role as chief executive of Affectiva.

Staff could see on El Kaliouby’s calendar that 3.30pm was demarcated to collect her son from school, and she explained to them that a Zumba class each Friday ensured a happier, healthier leader.

“I think it made for a much more authentic environment,” she says.

The family now lives in what El Kaliouby describes as a charming New England home filled with distinctive Middle Eastern touches and often by the aroma of molokhia soup made to her mother’s recipe.

Love for Egypt

“It’s very modern but with a lot of Egyptian things, Arab and Islamic inscriptions. I think of myself as Egyptian American, and very Egyptian in a lot of ways. I love Egypt. A lot of qualities – the Arab warmth, generosity and even intimacy – that’s very much who I am and I would say it’s the same for my kids.

“But I also have embraced what people would call American values. I’m very ambitious, very driven, very globally minded.”

That ambition and drive has taken her far. Affectiva is employed by brands in about 90 countries for market research, but also helps children with developmental difficulties, such as autism , to better interact with those around them.

More recently, the company has developed technology to make driving safer by enabling cars to detect if a motorist is becoming drowsy or distracted.

It was acquired in 2021 by the Swedish AI giant SmartEye for what was said to be about $73 million, with El Kaliouby becoming deputy chief executive.

She has long predicted that the day will come when all devices have an emotion chip and we won’t remember what it was like before screens could comprehend the meaning of us frowning at them.

“When we first started doing this work, we always said this will become ubiquitous and ingrained in every technology. Now, I think it’s more true than ever because AI is becoming a lot more conversational and perceptual.

“You can imagine that the final frontier is this emotional and social intelligence. Initially, my work was very much around human-to-computer interaction, making machines more intelligent, and how they communicate with humans.

“Now it’s back to the human connection. How are AI assistants and AI technologies going to make us better humans, especially better at connecting with each other?”

Along the way, she has learnt that daily affirmations are as integral to life as algorithms, and celebrating the small achievements, such as growing her own tulips, is as important as publishing a best-selling memoir, Girl Decoded.

Among the accolades amassed, El Kaliouby can cite becoming a World Economic Forum Young Global Leader, being listed on the Forbes Top 50 Women in Tech, and receiving the Smithsonian Magazine’s American Ingenuity Award in Technology. Earlier this year, she was invited to ring the opening bell on New York’s Nasdaq exchange as a female pioneer in AI, and was recently made a 2023 Eisenhower Fellow.

None of this seems to have gone to her head, however, perhaps because her family does a good job of keeping her grounded.

When El Kaliouby gave a TED Talk some years ago, she explained that in emotion science all facial muscle movements are measured as action units with specific numbers for each.

Words from the wise

In a throwback to those early guided sessions in the family living room in Kuwait, the night before she walked on stage, her daughter Jana, 12 at the time, helpfully texted: “Good luck mummy!! I’m sure your gonna do awesome. Remember: don’t play with your hair, connect with audience, give them a present, gesture on words, gesture to emphasise.”

The response sent in live time was the old-school 🙂 emoticon but the algorithm that is El Kaliouby’s labour of love would have strongly detected action unit 12, the main component of, in this particular case, a very indulgent smile.

From her parting message to readers of The National, it is clear that she won’t rest until the technology responds just as accurately across the whole gamut of social and emotional states irrespective of people’s age, gender or ethnicity. Going forward, El Kaliouby insists, the watchword has to be inclusivity.

“I’m on this mission to diversify the face of AI. So it’s a call to action to get involved. It’s super exciting and we need a lot of diverse people being part of it.”

source/content: thenationalnews.com (headline edited)

__________

_______________________

AMERICAN / EGYPT

ARAB AMERICANS: 06 Groundbreaking Innovations by Arab Americans

Americans born in or with ancestral ties to Arab-speaking countries have made countless significant scientific, medical and engineering contributions.

While Americans born in or with ancestral ties to Arab countries have made countless significant scientific, medical and engineering contributions, most have never made it into record books. From cryptography, to the artificial heart, to the iPod, here are a few examples of some of the major advancements by Arab Americans.

1. Television Transmission and LCD Screens

Born in Nabatieh, Lebanon in 1895, Hassan Kamel Al-Sabbah studied and then taught mathematics at the American University of Beirut before immigrating to the United States in 1921. After a brief stint studying at the Massachusetts Institute of Technology (MIT), Al-Sabbah earned a master’s degree in engineering sciences from the University of Illinois, says Lujine Nasralla, communications specialist at the Arab American National Museum in Dearborn, Michigan.

“In 1923, General Electric (GE) hired him to work in its Engineering Laboratory under a contract that awarded him a dollar for each of his patents,” Nasralla explains, noting that between 1927 and 1935, he applied for patents for 52 of his inventions while working at GE. Some of the patents Al-Sabbah was awarded during his time at GE include three for innovations in television transmission technology (granted between 1928 and 1930), and two for cathode ray tubes (1935).

Though Al-Sabbah died in a car accident 1935, GE engineers continued to rely on the technology he invented, including developing the liquid crystal display (LCD) based on one of his patents. Al-Sabbah made numerous other significant contributions to science, technology and engineering, especially in the field of solar energy.

2. Emotion Recognition Technology

RANA EL KALIOUBY, CO-FOUNDER AND CHIEF EXECUTIVE OFFICER OF AFFECTIVA, SPEAKING DURING THE NEW WORK SUMMIT, CALIFORNIA, 2019. / DAVID PAUL MORRIS/BLOOMBERG VIA GETTY IMAGES

While Rana El Kaliouby was completing her doctoral research at the University of Cambridge in England in the early 2000s, she never felt as though she could ever truly connect with her loved ones back home. “Away from her family and friends in Egypt, El Kaliouby wished her computer could better convey her emotional state,” Nasralla says. That’s when she decided to find a way to make more emotionally intelligent technology.

After earning her doctorate, El Kaliouby took a position as a research scientist in the Affective Computing group in the MIT Media Lab. There, she was part of a team that developed an “emotional hearing aid,” as well as a pair of eyeglasses that could read emotions, along with social cues. Officially known as “the Emotional-Social Intelligence Prosthesis,” El Kaliouby and a colleague created the wearable technology in 2006 for people living with autism who have difficulty identifying and processing other people’s emotions as they communicate.

In 2009, El Kaliouby and the same MIT colleague co-founded a company called Affectiva, which used deep learning, computer vision, speech science and vast amounts of real-world data to develop emotion recognition technology. “Her pioneering technology accurately reads minute changes in facial expressions that convey emotions,” Nasralla says, adding that El Kaliouby is a member of the Women in Engineering Hall of Fame.

3. The iPod and iPhone

TONY FADELL, WHO OVERSAW THE DESIGN OF THE IPOD AND IPHONE, PHOTOGRAPHED IN SINGAPORE, 2019 / WEI LENG TAY/BLOOMBERG VIA GETTY IMAGES

There was a time in the not-so-distant past when listening to music outside of your home meant bringing the physical album with you on a record, audio cassette or compact disc. And while portable MP3 players existed before 2001, none were popular enough to make the device the standard way of listening to music on the go. That is, until Apple CEO Steve Jobs hired Arab American inventor Anthony “Tony” Fadell and put him in charge of a new special projects group within the company tasked with doing exactly that.

The result was the iPod, which launched in 2001. Fadell, who is now known as the father of iPod,” went on to oversee the first 18 iterations of the device before Jobs gave him his next assignment: to create a mobile phone with many of the same features as the iPod. 

This time, the end product was the iPhone, which essentially allowed people to carry a highly compact computer with internet capability around at all times, and, in the process, changing the way people access information. Fadell was involved with developing the first three generations of the iPhone.

4. Developments in Surgery

HEART SPECIALIST DR. MICHAEL DEBAKEY, C. 1994. / F. CARTER SMITH/SYGMA/GETTY IMAGES

Born in Lake Charles, Louisiana in 1908 to Lebanese immigrants, Michael DeBakey (the Anglicized form of Debaghi) grew up spending time in his father’s pharmacy and enjoyed sewing, gardening and learning how motors and other machinery work. He earned his medical degree in 1932 and served in the Surgical Consultants Division of the Army Surgeon General’s Office from 1942 to 1946.

It was during this time that DeBakey and his colleagues developed special units dedicated to providing surgical care to soldiers wounded near the front lines. They were first deployed in 1943, though are best known for their work during the Korean and Vietnam conflicts, when they were known as the Mobile Auxiliary Surgical Hospital (MASH) units.

DeBakey’s surgical contributions continued for the next several decades and included performing the first successful removal of a blockage of the carotid artery (1953), developing the concept behind coronary bypass surgery (1963), pioneering the field of telemedicine with the first demonstration of open-heart surgery transmitted overseas via satellite (1965), and being the first to use a partial artificial heart (1966).

5. Internet Security

While internet security is top-of-mind now, that wasn’t the case when Egyptian-born cryptographer Taher Elgamal began his pioneering work in the field in the 1980s. “Elgamal published a paper in 1984, ‘A Public Key Cryptosystem and a Signature Scheme based on Discrete Logarithms,’ which became the basis of the Elgamal Digital Signature algorithm,” says Richard Gardner, a software developer and CEO of Modulus. This work was then utilized in the development of the Digital Signature Algorithm (DSA).”

Elgamal’s work became even more influential after the National Institute of Standards and Technology (NIST) adopted it as the Digital Signature Standard (DSS). “Like the name implies, it became the standard for electronic signatures,” Gardner explains.

And according to Abdulrahman Henedy, an Arab American entrepreneur and founder of Financeive , Elgamal’s invention of the discrete logarithm was also an important milestone in cryptography. “His work inspired other encryption variations and paved the way to create more advanced algorithms, like Advanced Encryption Standard,” he explains.

In addition, Elgamal was the driving force behind the Secure Sockets Layer (SSL), a protocol that keeps online communications like email and instant messaging secure. Because of this major technological development, he is known as the “father of SSL.”

6. The Waffle Cone

Though it may not be the most high-tech invention on the list, the waffle cone stands out not only because it’s delicious, but because not one, but four different Arab Americans claimed to have invented it. And what’s perhaps even more bizarre, is that in an origin story with so many inconsistencies, all four of the men contend that their ice cream innovation was born at the 1904 Louisiana Purchase Exposition—better known as the Saint Louis World’s Fair.

According to Nasralla, Ernest Hamwi, Nick Kabbaz, Abe Doumar and Leon B. Holwey each had their own story about how they came up with the waffle cone in 1904. “We give credit to all four of them, but we don’t recognize any of the stories as more plausible than the others,” she explains. “It remains a mystery to this day!”

But that mystery extends beyond which of the Arab American vendors (if any) deserves credit for the waffle cone. That’s because on top of these four narratives, there are several other origin stories , including some that took place prior to 1904. And though we may never know who first devised a handheld edible ice cream container, it’s safe to say that the 1904 World Fair and its Arab American dessert vendors did have a hand in popularizing what we now know as the waffle cone.

source/content: history.com (headline edited) / Elizabeth Yuko

____________

HEART SURGEON DR. MICHAEL DEBAKEY. CREDIT: BETTMANN ARCHIVE/GETTY IMAGES

_________________________________

AMERICAN / ARAB-AMERICAN