SKICAT: Sky Image Cataloging and Analysis Tool
Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence. Videos. Pages 2067-2067.
Abstract
- Breiman, L., Friedman, J .H., Olshen, R.A. and Stone, C.J. 1984. Classification and Regression Trees. Monterey, CA: Wadsworth & Brooks.
- Cheeseman, P. and Stutz, J. 1995. Bayesian Clas- sification (AutoClass): Theory and Results. In Ad- vances in Knowledge Discovery and Data Mining, U. Fayyad et al (Eds.), Boston: AAAI/MIT Press .
- DeCarvalho, R., Djorgovski, S.G., Weir, N., Fayyad, U., Cherkauer, K., Roden, J., and Gray, A. 1995 . Clustering Analysis Algorithms and Their Applica- tions to Digital POSS-II Catalogs. in R. Hanisch, et a/. (Eds.), Astronomical Data Analysis Software and Systems IV, A.S.P. Conf. Ser. in press.
- Djorgovski, S.G., Weir, N., and Fayyad, U. M. 1994. Processing and Analysis of the Palomar -STScl Digital Sky Survey Using a Novel Software Tech- nology. In D. Crabtree, R. Hanisch, and J . Barnes (Eds.), Astronomical Data Analysis Software and Systems III, A.S.P. Conf. Ser. 61, 195.
- Fayyad, U.M. and Irani, K.B. 1992a. The Attribute Selection Problem in Decision Tree Generation. In Proc. of the Tenth National Conference on Artificial Intelligence AAAI-92, pages 104-110, Cambridge, MA: MIT Press.
- Fayyad, U.M. and Irani, K.B. 1992b. On the Han- dling of Continuous-Valued Attributes in Decision Tree Generation. Machine Learning, vol.8, no.2.
- Fayyad, U.M. and Irani, K.B. 1993. Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning. In Proc. of the Thirteenth Inter. Joint Conf. on Artificial Intelligence, Cham- bery, France: IJCAII. IJCAI
- Fayyad, U.M., Weir, N., and Djorgovski, S.G. 1993. SKICAT: A Machine Learning System for the Au- tomated Cataloging of Large-Scale Sky Surveys. In Proc. of the Tenth International Conference on M a- chine Learning, 1993.
- Fayyad, U.M. 1994. Branching on Attribute Val- ues in Decision Tree Generation. In Proc. of the Twelfth National Conference on Artificial Intelli- gence AAAI-94, pages 601-606, Cambridge, MA, 1994. MIT Press.
- Quinlan, J. R. 1986. The induction of decision trees. Machine Learning, 1(1).
- Weir, N. 1994. Automated Analysis of the Digitized Second Palomar Sky Survey: System Design, Imple- mentation, and Initial Results. Ph.D. Dissertation, California Institute of Technology.
- Weir, N., Djorgovski, S.G., Fayyad, U.M., Smith , J.D., and Roden, J. 1994. Cataloging the Northern Sky Using a New Generation of Software Technol- ogy. In Astronomy From Wide-Field Imaging, H. MacGillivray et a/. (Eds.), Proceedings of the IAU Symp. #161, p. 205. Dordrecht: Kluwer.
- Weir, N., Fayyad, U.M., and Djorgovski, S.G . 1995. Automated Star/Galaxy Classification for Digitized POSS-11 . The Astronomical Journal, in press.
- Weir, N., Djorgovski, S.G. , and Fayyad, U.M. 1995. Initial Galaxy Counts From Digitized POSS-11. As- tronomical Journal, in press.
References were extracted automatically from the PDF and may contain errors.
Full text extracted automatically from the PDF; figures, tables and equations may differ. The PDF is the version of record.
1 Introduction
In astronomy and space sciences, we currently face a data glut crisis. The problem of dealing with the huge volume of data accumulated from a variety of sources, of correlating the data and extracting and visualizing the important trends, is now fully recognized. This problem will become more acute very rapidly, with the advent of new telescopes, detectors, and space missions, with the data flux measured in terabytes. We face a critical need for information processing technology and method ology with which to manage this data avalanche in order to produce interesting scientific results quickly and effi ciently. Developments in the fields of machine learning and AI can provide at least some solutions. Much of the future of scientific information processing lies in the implementation of these methods.
We present an application of supervised classification to the automation of the tasks of cataloging and ana lyzing objects in digitized sky images. The Sky Image Cataloging and Analysis Tool (SKICAT) was developed for use on the images resulting from the 2nd Palomar Observatory Sky Survey (POSS-11) conducted by the California Institute of Technology ( Caltech). The photo graphic plates collected from the survey are digitized at the Space Telescope Science Institute. This process will result in about 3,000 digital images of 23, 040 x 23, 040 16-bit pixels each, totalling over 3 terabytes of data. When complete, the survey will cover the entire northern sky in three colors, detecting virtually every sky object down to a B magnitude of 22. This is at least one magni tude fainter than previous comprable photographic sur veys. We estimate that there are on the order of 10 7 galaxies 10 9 stellar objects (including over 10 5 quasars) are detectable in this survey. This data set will be the most comprehensive large-scale imaging survey produced to date and will not be surpassed in scope until the com pletion of a fully digital all-sky survey.
The purpose of SKI CAT is to enable and maximize the extraction of meaningful information from such a large database in timely manner. The system is built in a modular way, incorporating several existing algorithms and packages. There are three basic functional compo nents to SKI CAT, serving the purposes of sky object cat alog construction, catalog management, and high-level statistical and scientific analysis.
2 Classifying Sky Objects
The first step in analyzing the results of a sky survey is to identify, measure, and catalog the detected obvalues of the attributes measured from the lower resolu tion plate image. Hence, in principle, the classifier will be able to classify objects in the photographic image that are simply too faint for an astronomer to classify by in spection. Using the class labels, the learning algorithms are basically being used to solve the more difficult prob lem of separating the classes in the multi-dimensional space defined by the set of attributes derived via image processing. This method is expected to allow us to clas sify objects that are at least one magnitude fainter than objects classified in photographic all-sky surveys to date.
By effectively defining robust features, we were able to obtain classifiers with an accuracy exceeding that of humans for faint objects [13] Since faint objects consti tute the majority of objects on any plate, this results in a dramatic increase in the number of classified objects available for further scientific analysis. In effect, this shows that the pixels contained important information that the human visual system could not extract. Projec tion of the high-dimensional pixel space onto a powerful lower-dimensional feature space allowed us to transform the problem into one that is easily solvable by a super vised learning algorithm. By defining additional "normal ized" image-independent attributes, we were able to ob tain high accuracy classifiers within and across photo graphic plates.
3 Conclusions
The implications of a tool like SKICAT for Astronomy may indeed be profound. One could reclassify any por tion of the survey using alternative criteria better suited to a particular scientific goal (e.g. star catalogs vs. galaxy catalogs). This changes the notion of a sky cat alog from the classical static entity "in print", to a dy namic, ever growing, ever improving, on-line database. The catalogs will also accommodate additional attribute entries, in the event other pixel-based measurements are deemed necessary. An important feature of the survey analysis system will be to facilitate such detailed interac tions with the catalogs. The catalog generated by SKI CAT will eventually contain about two billion entries representing hundreds of millions of sky objects. Unlike the traditional notion of a static printed catalog, we view our effort as targeting the development of a new gener ation of scientific analysis tools that render it possible to have a constantly evolving, improving, and growing catalog. Without the availability of these tools for the first survey (POSS-1) conducted over four decades ago, no objective and comprehensive analysis of the data was possible. In contrast, we are targeting a comprehensive sky catalog that will be available on-line for the use of the scientific community.
For future work, we are sudying the application of clustering algorithms (e.g. AutoClass [2]) to automate discovery of new classes in the large catalog databases created by SKICAT [13; 14; 3]
@inproceedings{ijcai1995p275,
title = {SKICAT: Sky Image Cataloging and Analysis Tool},
author = {Fayyad, Usama M.},
booktitle = {Proceedings of the Fourteenth International Joint Conference on
Artificial Intelligence, {IJCAI-95}},
publisher = {International Joint Conferences on Artificial Intelligence},
editor = {Chris S. Mellish},
pages = {2067--2067},
year = {1995},
note = {Videos},
url = {https://ijcai.org/proceedings/1995/275},
}
TY - CPAPER TI - SKICAT: Sky Image Cataloging and Analysis Tool AU - Fayyad, Usama M. T2 - Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, IJCAI-95 PB - International Joint Conferences on Artificial Intelligence PY - 1995 SP - 2067 EP - 2067 UR - https://ijcai.org/proceedings/1995/275 ER -Copied
Machine-readable versions of this paper, for tools and AI agents: