Aircraft collision avoidance systems rely on sensor information to detect and track intruding aircraft so that they may issue proper collision avoidance advisories. While typical surveillance sensors for manned aircraft include transponders and onboard radar, autonomous aircraft will require additional sensors both for redundancy and to replace the visual acquisition typically performed by the pilot. As a result, the community has proposed detecting other aircraft using vision-based sensors such as cameras. These sensors require the development of techniques to process images of the environment to detect intruding aircraft. To boost this development, this artifact provides a dataset of 72,000 labeled images of intruder aircraft with various lighting conditions, weather conditions, relative geometries, and geographic locations. For more information on the structure of this dataset as well as benchmark models and a full simulator, see https://github.com/sisl/VisionBasedAircraftDAA.