Bilal Shihab / Projects

ARcher

Best Hardware Hack at HackTX 2026. A bow glove I built for my team's augmented-reality tower-defense game. You defend a castle placed on your real floor through an iPhone, and the glove replaces tapping the screen: make a fist to draw, open your hand to fire:

Collaborated with Mohammad Rashid, Jay Damodaran and Krish SinghHackTX 2026, AustinOctober 2026Best Hardware Hack
Spec
Board
Seeed XIAO ESP32-S3
Draw sensor
Flex sensor, 10 kΩ divider
Tilt sensor
LSM6DSO32 IMU over I²C
Firmware
Arduino (C++)
Sensor loop
20 ms
Full draw
1.2 s fist hold
Link
JSON over UDP, phone hotspot
Power
USB power bank
Game
Unity 6, AR Foundation, ARKit (LiDAR)
Fig. 1Playing with the glove: the XIAO, the motion sensor and the wiring sit on a small breadboard on the back of the hand. More in our demo video.

Why I built it

I wanted to build something with hardware, and I wanted our project to stand apart in how it felt to play. A bow you draw with your own hand made it a very different game from one you play by tapping a screen.

I built the glove and its firmware, which calibrates each player's open hand and fist and saves them on the board, and I connected it to the game in C#. The glove takes over the bow when it connects, hands control back to touch if it drops, and fires arrows with the power it measured. Mohammad built the AR game in Unity: the castle on your floor, the trebuchets and the raid. Jay wrote the phone's side of the glove link, including the scheme that numbers every shot and sends each release three times, so a dropped packet can't lose an arrow or fire one twice.

The hard part

The hard part was getting the glove onto the phone's network. I first wrote the firmware in MicroPython, but no phone, iPhone or Android, could join a Wi-Fi network the glove hosted. The same network hosted by Arduino firmware worked right away, so I rewrote the firmware in Arduino overnight and had each glove join its player's iPhone hotspot instead. Even then, the ESP32-S3 only sees 2.4 GHz networks, so the hotspot needs Maximize Compatibility turned on, and the glove has to match the iPhone's name exactly, curly apostrophe included.

Power was the other problem. A LiPo cell on the board's 5 V pin never finished joining Wi-Fi, and a boost converter didn't fix it in the time we had. We ran each glove off a USB power bank instead.