HackerPapers

arXiv:1611.07526astro-ph.GA

The weirdest SDSS galaxies: results from an outlier detection algorithm

Dalya Baron, Dovi Poznanski

Early discovery. Linked by one identifiable commenter. This paper is outside the main ranking; a mention is not an endorsement.

Abstract

How can we discover objects we did not know existed within the large datasets that now abound in astronomy? We present an outlier detection algorithm that we developed, based on an unsupervised Random Forest. We test the algorithm on more than two million galaxy spectra from the Sloan Digital Sky Survey and examine the 400 galaxies with the highest outlier score. We find objects which have extreme emission line ratios and abnormally strong absorption lines, objects with unusual continua, including extremely reddened galaxies. We find galaxy-galaxy gravitational lenses, double-peaked emission line galaxies, and close galaxy pairs. We find galaxies with high ionisation lines, galaxies which host supernovae, and galaxies with unusual gas kinematics. Only a fraction of the outliers we find were reported by previous studies that used specific and tailored algorithms to find a single class of unusual objects. Our algorithm is general and detects all of these classes, and many more, regardless of what makes them peculiar. It can be executed on imaging, time-series, and other spectroscopic data, operates well with thousands of features, is not sensitive to missing values, and is easily parallelisable.

arXiv comments
MNRAS accepted. Weirdness score for all SDSS galaxies at http://www.wise-obs.tau.ac.il/~dovip/weird-galaxies/ and code available at https://github.com/dalya/WeirdestGalaxies
Journal reference
DOI
doi:10.1093/mnras/stw3021
Subjects
astro-ph.GAAstrophysics of Galaxies

On Hacker News

Linked by 1 identifiable commenter in 1 comment across 1 thread, from Feb 2024 to Feb 2024.

Comments linking this paper, per year.

Discussed in comments1 thread

    • Another approach is to create a synthetic joint distribution by combining the marginal distributions independently and train a random forest classifier to distinguish the synthetic joint from the real joint. If the classifier is unable, the distributions are uncorrelated.…

      david_dracoView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.