Employment
2019 –
Adobe Research · Los Angeles, CA
Principal Scientist
Invent new technologies and interactions that revolutionize the way people create.
2017 – 2019
Snap, Inc. · Los Angeles, CA
Sr. Manager, Research Engineering
Lead advanced engineering team focused on creating new technology and products.
2010 – 2017
Adobe Research · San Francisco, CA
Director, Research Engineering
Lead advanced engineering team focused on creating new technology and products.
2003 – 2004
Mass Sensors, Inc. · St. Louis, Missouri
Software Engineer
Develop software and firmware for chemical analysis equipment.
Internships
2008 – 2010
Adobe Creative Technologies Lab · San Francisco, CA
Research Intern
Understand and improve how programmers use the Web.
2006
Google · Mountain View, CA
Intern
Develop new ranking algorithms for personalized Web search, focusing on user location.
2005
Metris, Inc. (now Nikon, Inc.) · Dulles, VA
Application Software Engineer
Develop software for metrology solutions.
Patents Issued
2023
Video Search Segmentation
Hijung Shin, Cristin Ailidh Fraser, Aseem Agarwala, Lubomira Dontcheva, Joel Richard Brandt, Jovan Popovic
US Patent No. 11,810,358 · Issued November 7, 2023
Interacting With Hierarchical Clusters Of Video Segments Using A Metadata Search
Seth Walker, Joy Oakyung Kim, Morgan Nicole Evans, Najika Skyler Halsema Yoo, Aseem Agarwala, Joel Richard Brandt, Jovan Popovic, Lubomira Dontcheva, Dingzeyu Li, Hijung Shin, Xue Bai
US Patent No. 11,762,903 · Issued September 19, 2023
Selecting And Performing Operations On Hierarchical Clusters Of Video Segments
Seth Walker, Joy Oakyung Kim, Aseem Agarwala, Joel Richard Brandt, Jovan Popovic, Lubomira Dontcheva, Dingzeyu Li, Hijung Shin, Xue Bai
US Patent No. 11,631,434 · Issued April 18, 2023
Interacting With Hierarchical Clusters Of Video Segments Using A Video Timeline
Seth Walker, Joy Oakyung Kim, Aseem Agarwala, Joel Richard Brandt, Jovan Popovic, Lubomira Dontcheva, Dingzeyu Li, Hijung Shin, Xue Bai
US Patent No. 11,630,562 · Issued April 18, 2023
2022
Video Segmentation based on Detected Video Features using a Graphical Model
Hijung Shin, Cristin Ailidh Fraser, Aseem Agarwala, Lubomira Dontcheva, Joel Richard Brandt, Jovan Popovic
US Patent No. 11,455,731 · Issued September 27, 2022
Segmentation and Hierarchical Clustering of Video
Hijung Shin, Xue Bai, Aseem Agarwala, Joel R. Brandt, Jovan Popovic, Lubomira Dontcheva, Dingzeyu Li, Joy Oakyung Kim, Seth Walker
US Patent No. 11,450,112 · Issued September 20, 2022
2021
(Continuation) Inter-Context Coordination to Facilitate Synchronized Presentation of Image Content
Ian Wehrman, John Fitzgerald, Joel Brandt, Jesper Bache, David Tristram, Barkin Aygun
US Patent No. 10,908,764 · Issued February 2, 2021
Video Reformatting System
Joel Brandt, Giles Goodwin, Jared Iwata, Ian Wehrman
US Patent No. 10,887,542 · Issued January 5, 2021
2019
(Continuation) Undo, Redo, and State Switching Using Content-Addressable Data Structures
David P. Simons, James Acquavella, Gregory Evans, Joel Brandt
US Patent No. 10,402,481 · Issued September 3, 2019
User Interface Creation from Screenshots
Morgan Dixon, Lubomira Dontcheva, Joel Brandt, Amanda Swearngin
US Patent No. 10,360,473 · Issued July 23, 2019
2018
Inter-Context Coordination to Facilitate Synchronized Presentation of Image Content
Ian Wehrman, John Fitzgerald, Joel Brandt, Jesper Bache, David Tristram, Barkin Aygun
US Patent No. 10,073,583 · Issued September 11, 2018
2017
Undo, Redo, and State Switching Using Content-Addressable Data Structures
David P. Simons, James Acquavella, Gregory Evans, Joel Brandt
US Patent No. 9,842,094 · Issued December 12, 2017
2016
Methods and Apparatus for Code Segment Handling
Joel Brandt, Stephen Oney
US Patent No. 9,495,134 · Issued November 15, 2016
Patents Pending
2022
(Continuation) Interacting With Hierarchical Clusters Of Video Segments Using A Video Timeline
Filed October 19, 2022
Video Segment Selection And Editing Using Transcript Interactions
Filed internationally in Australia, China, and Germany
Filed October 17, 2022
Transcript Question Search For Text-Based Video Editing
Filed October 17, 2022
Display Screen Or Portion Thereof With Graphical User Interface
Filed October 17, 2022
Speaker Thumbnail Selection And Speaker Visualization In Diarized Transcripts For Text-Based Video
Filed October 17, 2022
Visual And Text Search Interface For Text-Based Video Editing
Filed October 17, 2022
Annotated Transcript Text And Transcript Thumbnail Bars For Text-Based Video Editing
Filed October 17, 2022
Transcript Paragraph Segmentation And Visualization Of Transcript Paragraphs
Filed October 17, 2022
(Continuation) Modifying A Default Video Segmentation
Filed June 8, 2022
(Continuation) Hierarchical Segmentation Based On Voice-Activity Detection
Filed June 2, 2022
(Continuation) Hierarchical Segmentation Based Software Tool Usage In A Video
Filed June 2, 2022
(Continuation) Hierarchical Segmentation Of Screen Captured, Screencasted, Or Streamed Video
Filed June 2, 2022
Interacting With Semantic Video Segments Through Interactive Tiles
Filed internationally in Australia, China, Germany, and United Kingdon
Filed May 26, 2022
2021
Snap Point Video Segmentation Identifying Selection Snap Points For A Video
Filed May 26, 2021
Thumbnail Video Segmentation Identifying Thumbnail Locations For A Video
Filed May 26, 2021
2020
Interacting With Hierarchical Clusters Of Video Segments Using A Metadata Panel
Filed September 10, 2020
Awards and Fellowships
2019
Best Paper Honorable Mention · ACM SIGCHI Conference on Human Factors in Computing Systems
Paper Title: Implementing Multi-Touch Gestures with Touch Groups and Cross Events
2018
Best Paper · ACM SIGCHI Conference on Human Factors in Computing Systems
Paper Title: Extending Manual Drawing Practices with Artist-Centric Programming Tools
2017
Best Paper · ACM SIGCHI Conference on Human Factors in Computing Systems
Paper Title: Supporting Expressive Procedural Art Creation through Direct Manipulation
2010
Best Paper Honorable Mention · ACM SIGCHI Conference on Human Factors in Computing Systems
Paper Title: Example-Centric Programming: Integrating Web Search into the Programming Environment
2010
Best Paper Honorable Mention · ACM SIGCHI Conference on Human Factors in Computing Systems
Paper Title: What Would Other Programmers Do? Suggesting Solutions to Error Messages
2009
Best Paper Honorable Mention · ACM SIGCHI Conference on Human Factors in Computing Systems
Paper Title: Two Studies of Opportunistic Programming: Interleaving Web Foraging, Learning, and Writing Code
2008 – 2010
Stanford Graduate Fellowship · Stanford University
2005 – 2006
Stanford School of Engineering Fellowship · Stanford University
2001 – 2005
Pace Fellowship · Washington University in St. Louis
Merit-based full tuition scholarship for undergraduate study
2004
NSF Undergraduate Research Fellowship · Washington University in St. Louis
Mentorship and Collaboration
Advisees
2014 – 2017
Jennifer Jacobs · PhD Student, Media Lab, Massachusetts Institute of Technology
Generals Committee, Reading and Oral Examination Committees
Thesis title: Dynamic Drawing: Broadening Practice and Participation in Procedural Art
2014 – 2016
Jan-Peter Krämer · PhD Student, RWTH Aachen University
Reading and Oral Examination Committees
Thesis title: Interacting with Code: Observations, Models, and Tools for Usable Software Development Environments
2011 – 2015
Stephen Oney · PhD Student, Carnegie Mellon University
Reading and Oral Examination Committees
Thesis title: Expressing Interactivity with States and Constraints
Interns Supervised
2016
Amanda Swearngin · PhD Student, University of Washington
2015, 2014
Jennifer Jacobs · PhD Student, Media Lab, Massachusetts Institute of Technology
2015
Sumit Gogia · MS Student, Media Lab, Massachusetts Institute of Technology
2014
Jan-Peter Krämer · PhD Student, RWTH Aachen University
2014
Victor Santos Uceta · PhD Student, Purdue University
2013
Dennis Kehrig · Diplom-Informatiker (Masters) Student, RWTH Aachen University
2013, 2012
Thomas Lieber · PhD Student, Massachusetts Institute of Technology
2013, 2011
Stephen Oney · PhD Student, Carnegie Mellon University
2012
Ian Wehrman · Postdoc Researcher, University of Texas at Austin
2012
Jonathan Diehl · PhD Student, RWTH Aachen University
2012
Robert Morris · PhD Student, Media Lab, Massachusetts Institute of Technology
2011
Juho Kim · PhD Student, Massachusetts Institute of Technology
Students Supervised
2012
Suryaveer Singh Lodha · Masters Student, UC Berkeley
2012
Ayden Ye · Masters Student, UC Berkeley
2012
Yin-Chia Yeh · Masters Student, UC Berkeley
Collaborators
Michael Bernstein (Stanford),
Jan Borchers (RWTH Aachen),
William Choi (Stanford),
Mira Dontcheva (Adobe),
Ethan Fast (Stanford),
Krzysztof Gajos (Harvard),
Sumit Gogia (MIT Media Lab),
Philip Guo (Stanford/MIT/Rochester),
Bjoern Hartmann (UC Berkeley),
Jennifer Jacobs (MIT Media Lab),
David Karger (MIT),
Dennis Kehrig (RWTH Aachen),
Juho Kim (MIT),
Scott Klemmer (Stanford/UCSD),
Jan-Peter Krämer (RWTH Aachen),
Joel Lewenstein (Stanford),
Thomas Lieber (MIT),
Daniel MacDougall (Stanford),
Robert Miller (MIT),
Robert Morris (MIT),
Brad Myers (CMU),
Stephen Oney (CMU),
Victor Santos Uceta (Purdue),
Amanda Swearngin (University of Washington),
Ian Wehrman (UT Austin),
Doug Wightman (Queens University, Ontario),
Noah Weiss (Stanford),
Leslie Wu (Stanford),
Ron Yeh (Stanford)
Invited Talks
2016
Keynote at VISSOFT 2016: IEEE Working Conference on Software Visualization · Raleigh, NC
2015
Carnegie-Mellon University Human-Computer Interaction Seminar · Pittsburg, PA
2014
Segal Design Institute Seminar at Northwestern University · Evanston, IL
2012
Berkeley Institute of Design Seminar · Berkeley, CA
2011
MIT Human-Computer Interaction Seminar · Cambridge, MA
2011
Carnegie-Mellon University Human-Computer Interaction Seminar · Pittsburg, PA
2010
UC Boulder Human-Computer Interaction Seminar · Boulder, CO
Academic Service
2016
UIST Program Committee · ACM Symposium on User Interface Software and Technology
2015
CHI Program Committee · Specific Application Areas Subcommittee, ACM Conference on Human Factors in Computing Systems
2014
UIST Program Committee · ACM Symposium on User Interface Software and Technology
2014
VL/HCC Program Committee · IEEE Symposium on Visual Languages and Human-Centric Computing
2013
WWW Research Track Program Committee · User Interfaces, Human Factors, and Smart (Mobile) Devices Track, International World Wide Web Conference
2012
UIST Program Committee · ACM Symposium on User Interface Software and Technology
2012
HCOMP Program Committee · AAAI Human Computation Workshop
2011
UIST Program Committee · ACM Symposium on User Interface Software and Technology
2009
CHI Work-in-Progress Program Committee · ACM SIGCHI Conference on Human Factors in Computing Systems
Reviewing · CHI, ToCHI, UIST, CSCW, HCOMP, WWW, IUI, Communications of the ACM, IEEE Magazine