秘密直播

Feature Story

Pedro Rodriguez: Natural Intelligence

Pedro Rodriguez

A search for precision led Pedro Rodriguez into his career as an electrical engineer, but because of his insights into new possibilities, he now helps lead 秘密直播 APL鈥檚 AI and machine-learning efforts. Today, he sees the potential power and precision of artificial intelligence and machine-learning tools as keys to better protect a changing world.

Fold, tape, flip; fill, fold, tape. Fold, tape, flip; fill, fold, tape.

When Hurricane Maria ravaged the island of Puerto Rico in September 2017, Pedro Rodriguez and his wife, Laura, nervously anticipated word from their loved ones. For two weeks, they waited in the dark. 鈥淟ike, literally, the entire island disappeared electronically,鈥 Pedro says. 鈥淔or days.鈥

While their minds raced, and their nerves frayed, they became cardboard-box-making specialists.

Fold, tape, flip; fill, fold, tape.

They tried to avoid wringing their hands, so instead busied them by making care packages. 鈥淲e just bought as many supplies as we could. We prepared boxes, and as soon as we heard 鈥楶ost Office open,鈥 down they went,鈥 Laura recalls.

Canned chicken and vegetables. Batteries. Handheld fans. If they thought it might provide some help, comfort or assistance as their families 鈥 and their homeland 鈥 recovered from the monstrous Category 5 storm, into the boxes it went.

鈥淥ur way of coping,鈥 Laura says, 鈥渨as to try to help.鈥

Perhaps, then, it鈥檚 not surprising that more than three years later, Pedro Rodriguez finds his professional expertise has enabled him to expand that ethos to a grander scale.

As the senior technical leader of multiple deep learning artificial intelligence projects at the 秘密直播 Applied Physics Laboratory in Maryland, Pedro has a vast portfolio. One highlight is APL鈥檚 Humanitarian Assistance for Disaster Relief program, a machine-learning and artificial intelligence-enabled program to collect and process overhead imagery into categories for analysis. It allows disaster recovery teams to assess in hours what has previously taken days, or sometimes weeks.

HADR, as the program is known, processes flood segmentation (locating and marking areas of flooding), road analysis (identifying blocked and unblocked roads), and building damage assessment. That last one, which classifies buildings based on the Federal Emergency Management Agency鈥檚 (FEMA) protocol, categorizes structures into no damage, minor damage, major damage and completely destroyed.

In partnership with the Department of Defense鈥檚 Joint Artificial Intelligence Center, HADR was pressed into service to aid FEMA鈥檚 recovery efforts after 2018鈥檚 Hurricane Florence and 2019鈥檚 Hurricane Dorian devastated parts of the U.S. and the Caribbean islands. It was called to action in 2020 after Hurricane Laura, a deadly and destructive Category 4 storm, battered Louisiana.

鈥淚t was coincidence,鈥 Pedro explains of the link between his professional project and his personal hurricane history, noting APL was able to quickly leverage technology developed for another project when the light bulb went off that it could dramatically assist in these situations.

鈥淏ut now, we are all in.鈥

Experiencing hurricanes, knowing especially what my family went through most recently, has played a huge role in my enthusiasm for this project. Once we started using this technology for disaster relief applications, I just knew it was an area we could profoundly impact.

The silence that turned Pedro and Laura into mailing mavens finally broke after a couple of weeks. One of Pedro鈥檚 aunts was able to drive to a specific spot on the island where she鈥檇 search for cell phone service and send word that, fortunately, all were OK. After two weeks, the landline in Laura鈥檚 mom鈥檚 house started working again, and neighbors she hadn鈥檛 seen in years lined up at her door to ask for its use.

Pedro鈥檚 lasting impression of his first visit back after Maria was visual. 鈥淭here was no green,鈥 he says, all the trees and bushes left bare from the storm.

that occurrences and strengths of major hurricanes are expected to increase as the planet warms. In 2020, there were a record 30 named storms during the Atlantic hurricane season. Personal experiences aside, the world鈥檚 ability for people, states and countries to recover from these dangerous events is, and will continue to be, paramount. Pedro knows that.

鈥淓xperiencing hurricanes, knowing especially what my family went through most recently, has played a huge role in my enthusiasm for this project,鈥 he says. 鈥淥nce we started using this technology for disaster relief applications, I just knew it was an area we could profoundly impact.

鈥淚 want this to be a strength of our group for a long, long time.鈥

APL Icon

It was the search for precision that led Pedro Rodriguez, an electrical engineer in a family of civil engineers (and one accountant), to machine learning and image recognition. Once, in an electromagnetic class in college at the University of Puerto Rico, he was designing an antenna for radar that wasn鈥檛 working quite right. His professor took a look and devised a quick fix.

鈥淗e pulled out a knife and cut a piece of the antenna off,鈥 Pedro recalls. 鈥淎nd suddenly, it worked. I was like, 鈥楢re you kidding me? Is this really engineering?鈥 The fact that it was not perfect, it freaked me out. To me, pixels in digital images are perfection.鈥

I鈥檝e heard people say he is the OG 鈥 the original gangster 鈥 of transfer learning here at the Lab. He was doing deep learning before it was cool.

About 10 years ago, before deep learning, machine learning and artificial intelligence were as commonly interspersed into the public lexicon, Pedro was a young(er) engineer focused on transfer learning 鈥 training a neural network on a problem similar to the one you鈥檙e trying to solve, then applying part of it in a new model on the actual problem.

鈥淚鈥檝e heard people say he is the OG 鈥 the original gangster 鈥 of transfer learning here at the Lab,鈥 Ryan Amundsen, a signal processing engineer at APL and a mentee of Pedro鈥檚, says with a chuckle. 鈥淗e was doing deep learning before it was cool.鈥

鈥淏ecause of how smart he is and his outgoing nature, I see Pedro as the person who kind of brought computer vision to the Lab for AI purposes,鈥 added Dean Fisher, who manages the Tactical Intelligence Systems Group at APL, putting Amundsen鈥檚 observation in, perhaps, more formal terms.

Pedro Rodriguez talks to a group of APL researchers
Today, Pedro Rodriguez is a prominent voice in APL鈥檚 artificial intelligence and machine-learning efforts. Ten years ago, he was walking around with a PowerPoint presentation trying to explain the neural network he鈥檇 built himself and how it could help. 鈥淲hen deep learning came about, I recognized that I could do with deep learning neural networks what I was doing with this other thing, called HMAX [Hierarchical Model and X]. The cool part was that it was like a one-week fix, and the results were immediately 20-40% better.鈥 PedroNet 鈥 a gray-scale, deep learning neural network that he鈥檇 trained himself in APL鈥檚 maker space, Central Spark 鈥 was born.

Credit: 秘密直播 APL

鈥淲hen deep learning came about, I recognized that I could do with deep learning neural networks what I was doing with this other thing, called HMAX [Hierarchical Model and X],鈥 Pedro explained. 鈥淭he cool part was that it was like a one-week fix, and the results were immediately 20-40% better.鈥

PedroNet 鈥 a grayscale, deep learning neural network that Pedro trained himself in APL鈥檚 maker space, Central Spark 鈥 was born. And his profile within the Laboratory skyrocketed.

鈥淲ord got around really fast,鈥 Pedro recalls of the interest in his work. 鈥淚 was literally walking around with PowerPoints, showing it to people.鈥

Pedro had wanted to be an astronaut and applied to NASA鈥檚 program (before completing his Ph.D.). He was introduced to the Laboratory (and his wife, who works as a systems accountant at APL) through an undergraduate internship at NASA鈥檚 Goddard Space Flight Center, a short distance from the Laboratory. His career, which he put on a beeline for the Lab after that initial taste from Goddard, began with work on classified projects in APL鈥檚 Force Projection Sector, where PedroNet came about. For now, Pedro is no closer to his goal of being an astronaut, and he鈥檚 still never worked in the Lab鈥檚 Space Exploration Sector.

In many ways, the successes that led him here 鈥 now a prominent voice in the Laboratory鈥檚 AI and machine-learning efforts 鈥 have come because of paths that diverged from their originally planned end point.

That was the antithesis of what he sought as a young professional. Pixels with a set value, processes that return specific 鈥 expected 鈥 results; these unshakeable constants lured him. 鈥淓ven though machine learning has some ambiguity to it, I remember feeling a sense of calm when I gravitated toward this field and computer vision.鈥

PedroNet, a microexample of his technical acumen, was part of what launched him on his current trajectory. His gregarious personality, introspective nature and unapologetic ambition helped too.

I think much of it comes back to the question of 鈥榃hat do you have to do to be world-class?鈥 You identify what you need to do and you do it. That鈥檚 Pedro in a nutshell.

鈥淗e was so open about sharing his knowledge and insight [that] people sought him out as the subject-matter expert in this emerging area,鈥 Fisher said. 鈥淏ut you see the impact now with the many premier programs the Lab is working on. That鈥檚 all part of [APL Director] Ralph Semmel鈥檚 strategic vision to make APL an AI center of excellence. Pedro鈥檚 contributions there have been tremendous, and it started with collaboration and his willingness to share.鈥

鈥淚 think much of it comes back to the question of 鈥榃hat do you have to do to be world-class?鈥欌 added John Piorkowski, the chief AI architect in APL鈥檚 Asymmetric Operations Sector and head of its Applied Information Sciences Branch, of which Pedro鈥檚 group is a part. 鈥淵ou identify what you need to do and you do it. That鈥檚 Pedro in a nutshell. He will put his mind to something and work to achieve it.鈥

APL Icon

On a frigid afternoon in mid-January 2020, Pedro pulls out his smartphone and drops it on the table in his office at APL鈥檚 suburban Maryland campus. To his right, a whiteboard displays work-related scribbles on its upper half and a DO NOT ERASE warning for the content below it 鈥 self-portraits of sorts drawn by his daughters, Natalia and Elena. Tiny reminders of his world outside these walls.

Open on the screen of his phone is QuakeFeed Earthquake Alerts, an app monitoring earthquake activity around the world. A larger reminder of that same world. Pedro鈥檚 filtering it to only show quakes registering 4.0 or higher on the Richter scale since Dec. 28.

Pedro Rodriguez's family photo
Pedro, bottom right, in an undated family photo with his parents, siblings and members of their extended family in Puerto Rico.

Credit: Pedro Rodriguez

He turns the phone.

鈥淭his is where all my family is,鈥 he says, zooming in on southwest Puerto Rico and the area where his hometown, Guanica, sits facing the Caribbean Sea. Red pins flood the region. His fingers tap the screen, removing the 4.0 or higher qualification, and the pins, denoting earthquakes, proliferate.

鈥淟ook at this,鈥 he says, his tone escalating with each finger stroke as he moves the map around. 鈥淚t is crazy. What the heck is this? When is it going to end? It feels like, every time it shakes, the damage caused takes the next step to being worse than Hurricane Maria.鈥

That is not a comparison Pedro makes lightly, particularly not after visiting Puerto Rico himself later that January and experiencing the aftershocks and tremors the locals understood could go on for a year or more. 鈥淭he randomness of destruction was shocking,鈥 he said. 鈥淚t was weird to see a house completely destroyed and the house next to it perfectly fine. That just did not compute in my mind. What is the difference between this house and that house?鈥

This destruction was loud; it was obvious. Disasters are like that, Pedro knows. He may not have been on the island during Maria, but he鈥檚 certainly experienced his share of hurricanes. It is, oddly, the quiet that Pedro remembers most about them.

Even now, more than two decades after Hurricane Georges ripped through his hometown, it鈥檚 not the destructive force of the 140-mph wind gusts, the driving rains and flooding, or the catastrophic damage that spring to his mind first. It is serenity. The tranquility of a sky suddenly so clear he and his brother walked outside to stare up, through Georges鈥 eye as it passed over their house, and gaze at the moon in the silence.

鈥淚t was like the most beautiful night,鈥 he says. 鈥淚f it had been daytime, the sun would鈥檝e shone on us.鈥

The peacefulness didn鈥檛 last 鈥 in part because the second wall of the storm was about to shatter its illusion, but, more to the point, because his father came running out of the house to corral his children back into the safety of its concrete walls. Minutes later, the storm鈥檚 pounding resumed. Their home was spared, but the family suffered through six months without power or water.

There was a lesson there for Pedro, though perhaps not one he realized. When it comes to disasters, every second counts. That urgency has guided Pedro over the course of his career. How can we do this better and faster?

That鈥檚 grown into its own legend in a way, as he鈥檚 taken on the moniker of a 鈥淏S detector.鈥 In more elegant terms, Pedro is consistent in that he can quickly detect when an approach is, well, hogwash.

鈥淵ou can trace that back to 2012 or 2013,鈥 Pedro says with a laugh when confronted about this nickname. 鈥淎t APL, one thing we take seriously is our role as a trusted agent. I did a high-level briefing on deep learning, and I just brought it back to Earth. 鈥業t works for this; it doesn鈥檛 work for this.鈥 For a long time, there鈥檚 been so much hype about deep learning, and while today there鈥檚 probably hundreds of people at APL who could tell you the truth and not overhype it, at the time it was refreshing to hear someone not trying to sell it.

鈥淎 couple weeks later, I was getting invited to a lot more high-level briefings so I could help evaluate the ideas that were being sold.鈥

APL Icon

Beatrice Garcia, a software developer in Pedro鈥檚 group at the Lab, offers a slight, quiet chuckle when asked about the process to become project manager for the Lab鈥檚 Humanitarian Assistance for Disaster Relief Program in 2019. Garcia, who has more recently been an integral member of the APL team providing essential data collection, curation and aggregation for the 秘密直播 Coronavirus Resource Center, describes her leadership experience before HADR as 鈥渧ery minor.鈥

鈥淚 think Pedro just took a risk,鈥 she says, noting that there is an established mentorship pipeline in their group, which she easily tapped into upon taking the role.

The real reason is a bit more layered, the outermost one being that Garcia鈥檚 technical expertise and track record made her name one leadership quickly identified and brought to Pedro as a possibility. His reasoning, though, reveals more about his management style than it may about Garcia.

One thing many people struggle to appreciate about deep learning is that it has made things that used to take teams of 50 people 鈥 20 of them Ph.D.s 鈥 years and millions of dollars to do, something a high schooler can do now.

鈥淭he reason was twofold,鈥 Pedro explains. 鈥淥ne thing many people struggle to appreciate about deep learning is that it has made things that used to take teams of 50 people 鈥 20 of them Ph.D.s 鈥 years and millions of dollars to do, something a high schooler can do now. A high schooler can buy a quadcopter, put in a small graphics processing unit, fly it in the air and do car detection. Twenty years ago, that was a $5 million project. Somebody with 20 years of experience might say, 鈥楾his is stupid, I鈥檝e tried this for years and it never worked,鈥 but now, in 2021, it works.

鈥淪ometimes experience lends itself to preconceived notions. I wanted an aspect of inexperience, somebody with fresh eyes, because I felt it could be an asset. I trusted the people who suggested Beatrice for this job, but the second part of this answer is that I strongly believe you learn by doing. You need to take risks. And in doing so, I knew we could exemplify that APL could put together young, diverse teams to tackle these kinds of projects, just like many of the deep learning teams in Silicon Valley.鈥

What Pedro hints at with his answer is not something he pinpoints himself, even later when asked about it directly: how does he, as a minority and hiring manager, approach diversity in a field that is historically not diverse?

鈥淚 kind of love being a minority,鈥 he says nonchalantly, expanding to say that鈥檚 particularly pertinent in his role now as a supervisor in the field of artificial intelligence, in which researchers have identified technical issues relating to racial bias. 鈥淏ut what I am always seeking is diversity of thought.鈥

He鈥檚 noticed, for example, that he gets a high number of applicants from Puerto Rico and posits that it鈥檚 possible that鈥檚 related to his representation. There are times, too, when he鈥檚 wondered if that鈥檚 the pendulum swinging too far the other direction. 鈥淛ohn Piorkowski once told me, 鈥業f somebody is super talented and wants to come to your group, and you being a minority became a magnet for them, that鈥檚 great.鈥 That鈥檚 very fulfilling to me.鈥

Within Pedro鈥檚 group, staff members have self-identified as members of at least five different races (including Hispanic, Black, Asian and Indian), and women make up 29% of the group 鈥 a number that nearly mirrored APL as a whole in 2020.

鈥淗e incorporates diversity without specifically trying to do so,鈥 Laura Rodriguez says of her husband. 鈥淚t happens naturally. When he started at APL, you could easily see that diversity wasn鈥檛 necessarily there. He stuck out as it. But now, there鈥檚 a little bit of everything, and everyone works well together. It鈥檚 the best group I鈥檝e seen him work with in terms of everyone getting along. That says to me that his qualities are coming through. His representation isn鈥檛 ceremonial.鈥

The Humanitarian Assistance for Disaster Relief program may be just one piece of the work that Pedro leads at the Laboratory, but it鈥檚 an apt lens through which to view this topic. Disasters do not discriminate. They are not a problem central to only one group of people; they are an affliction the world over.

Solving them, or at least figuring out how help for those in harm鈥檚 way can become more expedient and effective, should be a challenge tackled by a group representative of that fact. Whether it鈥檚 this specific problem or the next one the group tackles, that won鈥檛 change.

鈥淧edro has fostered a community here in the group,鈥 Amundsen said. 鈥淗e will challenge your technical abilities, but you will get opportunities based on where he鈥檚 taking that trajectory of technical expertise. And really, he helps you understand that you should make time do that.鈥

APL Icon
Pedro and Laura Rodriguez with their daughters
Pedro and Laura Rodriguez with their daughters, Natalia and Elena (6 and 9 years old). Pedro often thinks about the world his daughters will inhabit 鈥 the one he is helping to create now. 鈥淚 feel worry and hope about the future,鈥 he admits. 鈥淲hat will disasters 鈥 and recovery from them 鈥 look like in 50 years? But I also get excited about the possibility that my daughters will one day continue the work that we鈥檙e doing, that maybe they鈥檒l have a role in that future. That would be really cool.鈥

Credit: Pedro Rodriguez

More than a year after the earthquakes in Puerto Rico began, the aftershocks continue. In 2020, the Live data, Integration, Validation and Experimentation (LIVE) Lab at APL, where the Humanitarian Assistance for Disaster Relief program is run, added the code for the 秘密直播 COVID-19 dashboard (tracking a disaster of a different kind). Meanwhile, Pedro鈥檚 focus remains steadfast.

The coronavirus pandemic has altered the way the world views just about everything, but one disaster does not cede to another. In 2020, fires still raged, and hurricanes still stormed. Even deep freezes so catastrophic as to short Texas鈥 power grid didn鈥檛 take a year off. Through it all, Pedro鈥檚 belief in building the Laboratory into the place for AI in disaster response 鈥 human-made, natural, medical or otherwise 鈥 only grew.

鈥淚 really hope to see a future where AI is automatically applied to all kinds of sensor modalities, and we can respond to emergencies faster than ever,鈥 he said in late February this year. 鈥淚 want a future where the sensors looking at the world were designed for AI, instead of sensors designed for human decision-making.

鈥淚n that world, we could respond faster because we wouldn鈥檛 even need a human in the loop. The AI could simply report 鈥榝looding in this road鈥 and recovery teams could just go, without a need for human confirmation.鈥

Those hopes are also deeply personal. Natalia and Elena, 6 and 9 years old, will live in the world Pedro is helping to create. It鈥檚 natural to think about how that will affect those you love. He comes back to a central thought: will his lived experience help improve theirs?

鈥淚 feel worry and hope about the future,鈥 Pedro admits. 鈥淲hat will disasters 鈥 and recovery from them 鈥 look like in 50 years?

鈥淏ut I also get excited about the possibility that my daughters will one day continue the work that we鈥檙e doing, that maybe they鈥檒l have a role in that future. That would be really cool.鈥

APL Icon