research

Cyber Defense

Augmented Reality

Human-Machine Interfaces

Visual Communication

Cyber Defense

Defensive Cyber Deception and Game Theory


Software Immunization and Randomized Defense-in-Depth


Human Factors of Cyber Warfare

  • Oppositional Human Factors
    • Inverting human factors can aid in cyber defense by flipping well-known guidelines and using them to degrade and disrupt the performance of a cyber attacker. There has been significant research on how we perform cyber defense tasks and how we should present information to operators, cyber defenders, and analysts to make them more efficient and more effective. We can actually create these situations just as easily as we can mitigate them. Oppositional human factors are a new way to apply well-known research on human attention allocation to disrupt potential cyber attackers and provide much needed asymmetric benefits to the defender. (2018)
  • Human Factors of Cyber Defense

Augmented Reality

Privacy-Preserving Augmented Reality

Our Augmented Reality Cross-Domain Solution (AR-CDS) is a wearable which guarantees data privacy and confidentiality of data stored by the wearable computing device. Instead of using backchannels to inform and control the wearable device, the device itself uses machine vision algorithms to detect data on surrounding displays and computing devices, interprets detected on-screen objects and data in other device displays, and augments these displays with virtual overlays that are only viewable to the wearer.

Our team has explored numerous applications of augmented and virtual reality. A key assumption of most devices and implementations is that the wearable device can be directly connected to information systems and data sources in the surrounding environment and that the surrounding computing devices can directly manipulate or inform the wearable headset and its associated computing hardware via network connectivity. The AR-CDS is physically disconnected from the surrounding computing and network environment and only connects to networks and computing devices which are at the same sensitivity level of the wearable device. All external information is obtained via machine vision and interpretation of observable information channels in the surrounding environment.

Use Cases

  • Viewing contextual private personal information in a public space
    • Medical information (e.g. diagnostics, medical history)
    • Sensitive financial information (e.g. stock/securities holdings)
  • Viewing information in a mixed-classification environment
    • Confidential information
    • Security-sensitive information
    • Multiple viewers with different levels of access
  • Viewing identity-preserving personalized contextualized content
    • Contextual advertisements without disclosing personal identiy
    • Personal suggestions and interest markers

Patents

Ambient Displays and Wetware Threat Detection

Human-Machine Interfaces

Active Digital Data Transfer Devices

In 2009 and 2010 our team begain exploring alternative uses of capacative-touch-screens present on devices such as the iPad and iPhone. One novel use-case involved using the touch-screen digitizer directly for digital data input and output. Conventional stylus devices either act as pointing devices or utilize a backchannel through bluetooth or WiFi protocols to communicate with the device. In our implementation, the digitizer can be calibrated to allow for rapid sequences of touches to be interpreted directly as data. Rather than using a backchannel, the user can directly receive and send data through the screen itself. This dramatically simplifies data management and manipulation, allowing data to be literally held in your hand when transfering between devices.

Use cases

  • Input of data directly 'into' on-screen graphical elements (buttons, text fields) by touching the element.
  • Touching a business card to the screen to transfer contact information
  • Manipulation of on-screen visual elements or controls using digital signals

Patents

Electronic Glove (e-Glove)

From 2006-2012 our team explored the use of gesture-based data manipulation, inscription, communication, and human-machine interfaces. We created dozens of prototype devices for different environments and use-cases. Our devices allowed sub-milimeter tracking of individual digits that mapped to a skeletalmodel for real-time tracking of hand movement and gesture.

Uses cases

  • gaming
  • augmented and virtual reality
  • robotic control
  • digitization of hand signals (Navy Diving, Special Forces, NASA)
  • communication under durress (HazMat, Firefighting)
  • human-computer interaction (data input, keyboard emulation, mouse control)

Articles

  • Hand Signals. Patric Petrie and Sunny Fugate. CHIPS Magazine. July 2014.

Patents

Symbology and Visual Communication

Cyberspace Symbology

Although symbols did not originate with computer systems, their usage has peaked during the rise of the modern computer. In the last several decades human interaction with computing systems has relied on graphical user interfaces and using symbols and iconography to visualize applications, tools and commands. User interfaces have allowed for flexible task and data representation, which enable more agile human problem description and solution. Directly mapping abstract ideas, actions, and interactions into symbol shapes or sounds can initially prove fruitful through the careful application of metaphor and analogy, but is apt to result in poor usability strategy. Standards have been developed specifically to ameliorate information density problems and aid recognition, making critical relationships and knowledge about platform type, position, condition and capabilities easily viewable. Yet in many ways, current symbology solutions seem to apply only to the domain of physical world operations. Cyberspace differs substantially from physical space, affecting how operators attempt to gain awareness of the battlespace. Key differences between domains suggest symbology may need to branch away from existing standards while retaining some of the useful carryover elements. (Gutzwiller and Fugate, 2016.)

Cyber Hazard Warning Trefoil


Visual Language and Communication