Deep learning-based fine-grained car make/model classification for visual surveillance

Erhan Gundogdu, Enes Sinan Parlldl, Berkan Solmaz, Veysel Yücesoy, Aykut Koç

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations


Fine-grained object recognition is a potential computer vision problem that has been recently addressed by utilizing deep Convolutional Neural Networks (CNNs). Nevertheless, the main disadvantage of classification methods relying on deep CNN models is the need for considerably large amount of data. In addition, there exists relatively less amount of annotated data for a real world application, such as the recognition of car models in a traffic surveillance system. To this end, we mainly concentrate on the classification of fine-grained car make and/or models for visual scenarios by the help of two different domains. First, a large-scale dataset including approximately 900K images is constructed from a website which includes fine-grained car models. According to their labels, a state-of-The-Art CNN model is trained on the constructed dataset. The second domain that is dealt with is the set of images collected from a camera integrated to a traffic surveillance system. These images, which are over 260K, are gathered by a special license plate detection method on top of a motion detection algorithm. An appropriately selected size of the image is cropped from the region of interest provided by the detected license plate location. These sets of images and their provided labels for more than 30 classes are employed to fine-Tune the CNN model which is already trained on the large scale dataset described above. To fine-Tune the network, the last two fully-connected layers are randomly initialized and the remaining layers are fine-Tuned in the second dataset. In this work, the transfer of a learned model on a large dataset to a smaller one has been successfully performed by utilizing both the limited annotated data of the traffic field and a large scale dataset with available annotations. Our experimental results both in the validation dataset and the real field show that the proposed methodology performs favorably against the training of the CNN model from scratch.

Original languageEnglish (US)
Title of host publicationCounterterrorism, Crime Fighting, Forensics, and Surveillance Technologies
EditorsYitzhak Yitzhaky, Robert James Stokes, Henri Bouma, Felicity Carlysle-Davies
ISBN (Electronic)9781510613461
StatePublished - 2017
Externally publishedYes
EventCounterterrorism, Crime Fighting, Forensics, and Surveillance Technologies 2017 - Warsaw, Poland
Duration: Sep 11 2017Sep 12 2017

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X


ConferenceCounterterrorism, Crime Fighting, Forensics, and Surveillance Technologies 2017


  • Deep convolutional neural networks
  • Fine-Tuning
  • Fine-grained object recognition
  • traffic surveillance

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'Deep learning-based fine-grained car make/model classification for visual surveillance'. Together they form a unique fingerprint.

Cite this