Fabrizio Falchi
News

Cross-Media Learning for Image Sentiment Analysis in the Wild
Has been accepted at the 5th Workshop on Web-scale Vision and Social Media (VSM), ICCV 2017

Much progress has been made in the field of sentiment analysis in the past years. Researchers relied on textual data for this task, while only recently they have started investigating approaches to predict sentiments from multimedia content. With the increasing amount of data shared on social media, there is also a rapidly growing interest in approaches that work ``in the wild'', i.e. that are able to deal with uncontrolled conditions. In this work, we faced the challenge of training a visual sentiment classifier starting from a large set of user-generated and unlabeled contents. In particular, we collected more than 3 million tweets containing both text and images, and we leveraged on the sentiment polarity of the textual contents to train a visual sentiment classifier. To the best of our knowledge, this is the first time that a cross-media learning approach is proposed and tested in this context. We assessed the validity of our model by conducting comparative studies and evaluations on a benchmark for visual sentiment analysis.

L. Vadicamo, F. Carrara, A. Cimino, S. Cresci, F. Dell'Orletta, F. Falchi, M. Tesconi

@InProceedings{Vadicamo_2017_ICCV_Workshops,
author = {Vadicamo, Lucia and Carrara, Fabio and Cimino, Andrea and Cresci, Stefano and Dell'Orletta, Felice and Falchi, Fabrizio and Tesconi, Maurizio},
title = {Cross-Media Learning for Image Sentiment Analysis in the Wild},
booktitle = {The IEEE International Conference on Computer Vision (ICCV)},
month = {Oct},
year = {2017}
} 
Picture it in your mind.
Generating high level visual representations from textual descriptions
Has been accepted for the Information Retrieval Journal special issue on Neural Information Retrieval.

In this paper we tackle the problem of image search when the query is a short textual description of the image the user is looking for. We choose to implement the actual search process as a similarity search in a visual feature space, by learning to translate a textual query into a visual representation. Searching in the visual feature space has the advantage that any update to the translation model does not require to reprocess the (typically huge) image collection on which the search is performed. We propose various neural network models of increasing complexity that learn to generate, from a short descriptive text, a high level visual representation in a visual feature space such as the pool5 layer of the ResNet-152 or the fc6–fc7 layers of an AlexNet trained on ILSVRC12 and Places databases. The TEXT2VIS models we explore include (1) a relatively simple regressor network relying on a bag-of-words representation for the textual descriptors, (2) a deep recurrent network that is sensible to word order, and (3) a wide and deep model that combines a stacked LSTM deep network with a wide regressor network. We compare the models we propose with other search strategies, also including textual search methods that exploit state-of-the-art caption generation models to index the image collection.

F. Carrara, A. Esuli, T. Fagni, F. Falchi, A.M. Fernandez

@Article{Carrara2017,
author="Carrara, Fabio
and Esuli, Andrea
and Fagni, Tiziano
and Falchi, Fabrizio
and Moreo Fern{\'a}ndez, Alejandro",
title="Picture it in your mind: generating high level visual representations from textual descriptions",
journal="Information Retrieval Journal",
year="2017",
month="Oct",
day="14",
abstract="In this paper we tackle the problem of image search when the query is a short textual description of the image the user is looking for. We choose to implement the actual search process as a similarity search in a visual feature space, by learning to translate a textual query into a visual representation. Searching in the visual feature space has the advantage that any update to the translation model does not require to reprocess the (typically huge) image collection on which the search is performed. We propose various neural network models of increasing complexity that learn to generate, from a short descriptive text, a high level visual representation in a visual feature space such as the pool5 layer of the ResNet-152 or the fc6--fc7 layers of an AlexNet trained on ILSVRC12 and Places databases. The Text2Vis models we explore include (1) a relatively simple regressor network relying on a bag-of-words representation for the textual descriptors, (2) a deep recurrent network that is sensible to word order, and (3) a wide and deep model that combines a stacked LSTM deep network with a wide regressor network. We compare the models we propose with other search strategies, also including textual search methods that exploit state-of-the-art caption generation models to index the image collection.",
issn="1573-7659",
doi="10.1007/s10791-017-9318-6",
url="https://doi.org/10.1007/s10791-017-9318-6"
}
Detecting adversarial examples in deep neural networks
Has been presented at 16th International Workshop on Content-Based Multimedia Indexing (CBMI 2017).

Deep learning has recently become state-of-the-art in many computer vision applications and in image classification in particular. It is now a mature technology that can be used in several real-life tasks. However, it is possible to create adversarial examples, containing changes unnoticeable to humans, which cause an incorrect classification by a deep convolutional neural network. This represents a serious threat for machine learning methods. In this paper we investigate the robustness of the representations learned by the fooled neural network. Specifically, we use a kNN classifier over the activations of hidden layers of the convolutional neural network, in order to define a strategy for distinguishing between correctly classified authentic images and adversarial examples. The results show that hidden layers activations can be used to detect incorrect classifications caused by adversarial attacks.

F. Carrara, F. Falchi, R. Caldelli, G. Amato, R. Fumarola, R. Becarelli

@inproceedings{Carrara:2017:DAE:3095713.3095753,
 author = {Carrara, Fabio and Falchi, Fabrizio and Caldelli, Roberto and Amato, Giuseppe and Fumarola, Roberta and Becarelli, Rudy},
 title = {Detecting Adversarial Example Attacks to Deep Neural Networks},
 booktitle = {Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing},
 series = {CBMI '17},
 year = {2017},
 isbn = {978-1-4503-5333-5},
 location = {Florence, Italy},
 pages = {38:1--38:7},
 articleno = {38},
 numpages = {7},
 url = {http://doi.acm.org/10.1145/3095713.3095753},
 doi = {10.1145/3095713.3095753},
 acmid = {3095753},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {Adversarial images detection, Deep Convolutional Neural Network, Machine Learning Security},
} 
About

Fabrizio Falchi has a Ph.D. in Information Engineering from University of Pisa (Italy), and a Ph.D. in Informatics from Faculty of Informatics of Masaryk University of Brno (Czech Republic). He also recived an M.B.A. from Scuola Superiore Sant'Anna in Pisa. He is researcher at the Networked Multimedia Information System Laboratory of the Information Science and Technologies Institute of the Italian CNR in Pisa.

His research interests include deep learning, convolutional neural network, deep features, similarity search, distributed indexes, multimedia information retrieval, computer vision, peer-to-peer systems.


Member of acm since 2012, Fabrizio participates to SIGMM

Member of the Computer Vision Foundation CVF


Follow me
Publications

Selected

Detecting adversarial examples in deep neural networks

F. Carrara, F. Falchi, R. Caldelli, G. Amato, R. Fumarola, R. Becarelli

Proceedings of the 16th International Workshop on Content-Based Multimedia Indexing (CBMI 2017).

DOI: 10.1145/3095713.3095740

Deep learning has recently become state-of-the-art in many computer vision applications and in image classification in particular. It is now a mature technology that can be used in several real-life tasks. However, it is possible to create adversarial examples, containing changes unnoticeable to humans, which cause an incorrect classification by a deep convolutional neural network. This represents a serious threat for machine learning methods. In this paper we investigate the robustness of the representations learned by the fooled neural network. Specifically, we use a kNN classifier over the activations of hidden layers of the convolutional neural network, in order to define a strategy for distinguishing between correctly classified authentic images and adversarial examples. The results show that hidden layers activations can be used to detect incorrect classifications caused by adversarial attacks.
@inproceedings{Carrara:2017:DAE:3095713.3095753,
 author = {Carrara, Fabio and Falchi, Fabrizio and Caldelli, Roberto and Amato, Giuseppe and Fumarola, Roberta and Becarelli, Rudy},
 title = {Detecting Adversarial Example Attacks to Deep Neural Networks},
 booktitle = {Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing},
 series = {CBMI '17},
 year = {2017},
 isbn = {978-1-4503-5333-5},
 location = {Florence, Italy},
 pages = {38:1--38:7},
 articleno = {38},
 numpages = {7},
 url = {http://doi.acm.org/10.1145/3095713.3095753},
 doi = {10.1145/3095713.3095753},
 acmid = {3095753},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {Adversarial images detection, Deep Convolutional Neural Network, Machine Learning Security},
} 

Deep learning for decentralized parking lot occupancy detection

G. Amato, F. Carrara, F. Falchi, C. Gennaro, C. Meghini, C. Vairo

Expert Systems with Applications (ESWA)

Volume 72, 2017, Pages 327-334 - Online from 29/10/2016, Elsevier Sci LTD, Oxford, UK
ISSN: 0957-4174, eISSN: 1873-6793, WOS: 000392770900028, Scopus: 2-s2.0-85006097682, DOI: 10.1016/j.eswa.2016.10.055

A smart camera is a vision system capable of extracting application-specific information from the captured images. The paper proposes a decentralized and efficient solution for visual parking lot occupancy detection based on a deep Convolutional Neural Network (CNN) specifically designed for smart cameras. This solution is compared with state-of-the-art approaches using two visual datasets: PKLot, already existing in literature, and CNRPark-EXT. The former is an existing dataset, that allowed us to exhaustively compare with previous works. The latter dataset has been created in the context of this research, accumulating data across various seasons of the year, to test our approach in particularly challenging situations, exhibiting occlusions, and diverse and difficult viewpoints. This dataset is public available to the scientific community and is another contribution of our research. Our experiments show that our solution outperforms and generalizes the best performing approaches on both datasets. The performance of our proposed CNN architecture on the parking lot occupancy detection task, is comparable to the well-known AlexNet, which is three orders of magnitude larger.
		
@article{AMATO2017327,
title = "Deep learning for decentralized parking lot occupancy detection",
journal = "Expert Systems with Applications",
volume = "72",
number = "",
pages = "327 - 334",
year = "2017",
note = "",
issn = "0957-4174",
doi = "http://dx.doi.org/10.1016/j.eswa.2016.10.055",
url = "http://www.sciencedirect.com/science/article/pii/S095741741630598X",
author = "Giuseppe Amato and Fabio Carrara and Fabrizio Falchi and Claudio Gennaro and Carlo Meghini and Claudio Vairo",
keywords = "Machine learning",
keywords = "Classification",
keywords = "Deep learning",
keywords = "Convolutional neural networks",
keywords = "Parking space dataset"
}

YFCC100M-HNFC6: A large-scale deep features benchmark for similarity search

G. Amato, F. Falchi, C. Gennaro, F. Rabitti

Similarity Search and Applications: 9th International Conference, SISAP 2016 . Tokyo, Japan, October 24-26, 2016

Lecture Notes in Computer Science Volume, vol. 9939, Pages 196-209, Springer International Publishing Switzerland (Cham, Switzerland), 2016
ISSN: 0302-9743, ISBN: 978-3-319-46759-7, WOS: 000389801100015, Scopus: 2-s2.0-84989904386, DOI: 10.1007/978-3-319-46759-7_15

In this paper, we present YFCC100M-HNfc6, a benchmark consisting of 97M deep features extracted from the Yahoo Creative Commons 100M (YFCC100M) dataset. Three type of features were extracted using a state-of-the-art Convolutional Neural Network trained on the ImageNet and Places datasets. Together with the features, we made publicly available a set of 1,000 queries and k-NN results obtained by sequential scan. We first report detailed statistical information on both the features and search results. Then, we show an example of performance evaluation, performed using this benchmark, on the MI-File approximate similarity access method.
@Inbook{Amato2016,
 author="Amato, Giuseppe and Falchi, Fabrizio and Gennaro, Claudio
 and Rabitti, Fausto",
 title="YFCC100M-HNfc6: A Large-Scale Deep Features Benchmark for Similarity Search",
 bookTitle="Similarity Search and Applications: 9th International Conference, SISAP 2016, Tokyo, Japan, October 24-26, 2016, Proceedings",
 year="2016",
 publisher="Springer International Publishing",
 address="Cham",
 pages="196--209",
 isbn="978-3-319-46759-7",
 doi="10.1007/978-3-319-46759-7_15",
 url="https://doi.org/10.1007/978-3-319-46759-7_15"
}

YFCC100M HybridNet fc6 Deep Features for Content-Based Image Retrieval

G. Amato, F. Falchi, C. Gennaro, F. Rabitti

Proceedings of the 2016 ACM Workshop on Multimedia COMMONS, MMCommons '16

ACM New York, NY, USA ISBN: 978-1-4503-4515-6, Scopus: 2-s2.0-84995553525 | DOI: 10.1145/2983554.2983557

This paper presents a corpus of deep features extracted from the YFCC100M images considering the fc6 hidden layer activation of the HybridNet deep convolutional neural network. For a set of random selected queries we made available k-NN results obtained sequentially scanning the entire set features comparing both using the Euclidean and Hamming Distance on a binarized version of the features. This set of results is ground truth for evaluating Content-Based Image Retrieval (CBIR) systems that use approximate similarity search methods for efficient and scalable indexing. Moreover, we present experimental results obtained indexing this corpus with two distinct approaches: the Metric Inverted File and the Lucene Quantization. These two CBIR systems are public available online allowing real-time search using both internal and external queries.
@inproceedings{Amato:2016:YHF:2983554.2983557,
 author = {Amato, Giuseppe and Falchi, Fabrizio and Gennaro, Claudio and Rabitti, Fausto},
 title = {YFCC100M HybridNet Fc6 Deep Features for Content-Based Image Retrieval},
 booktitle = {Proceedings of the 2016 ACM Workshop on Multimedia COMMONS},
 series = {MMCommons '16},
 year = {2016},
 isbn = {978-1-4503-4515-6},
 location = {Amsterdam, The Netherlands},
 pages = {11--18},
 numpages = {8},
 url = {http://doi.acm.org/10.1145/2983554.2983557},
 doi = {10.1145/2983554.2983557},
 acmid = {2983557},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {YFCC100M, content-based image retrieval, deep features, multimedia information retrieval},
}


Aggregating binary local descriptors for image retrieval

Amato G., Falchi F., Vadicamo L.

Multimedia Tools and Applications (MTAP)

Springer US, 2017, in Press. ISSN: 1380-7501, eISSN: 573-7721
WOS: XXX | Scopus: 2-s2.0-85014088854 | DOI: 10.1007/s11042-017-4450-2

Content-Based Image Retrieval based on local features is computationally expensive because of the complexity of both extraction and matching of local feature. On one hand, the cost for extracting, representing, and comparing local visual descriptors has been dramatically reduced by recently proposed binary local features. On the other hand, aggregation techniques provide a meaningful summarization of all the extracted feature of an image into a single descriptor, allowing us to speed up and scale up the image search. Only a few works have recently mixed together these two research directions, defining aggregation methods for binary local features, in order to leverage on the advantage of both approaches.In this paper, we report an extensive comparison among state-of-the-art aggregation methods applied to binary features. Then, we mathematically formalize the application of Fisher Kernels to Bernoulli Mixture Models. Finally, we investigate the combination of the aggregated binary features with the emerging Convolutional Neural Network (CNN) features. Our results show that aggregation methods on binary features are effective and represent a worthwhile alternative to the direct matching. Moreover, the combination of the CNN with the Fisher Vector (FV) built upon binary features allowed us to obtain a relative improvement over the CNN results that is in line with that recently obtained using the combination of the CNN with the FV built upon SIFTs. The advantage of using the FV built upon binary features is that the extraction process of binary features is about two order of magnitude faster than SIFTs.
@Article{Amato2017,
author="Amato, Giuseppe and Falchi, Fabrizio and Vadicamo, Lucia",
title="Aggregating binary local descriptors for image retrieval",
journal="Multimedia Tools and Applications",
year="2017",
month="Mar",
day="02",
issn="1573-7721",
doi="10.1007/s11042-017-4450-2",
url="https://doi.org/10.1007/s11042-017-4450-2"
}

A comparison of pivot selection techniques for permutation-based indexing

G. Amato, A. Esuli, F. Falchi

Information Systems, Volume 52, August–September 2015, Pages 176–188

ISSN: 0306-4379, WOS: 000356983400012 | Scopus: 2-s2.0-84930083486 | DOI: 10.1016/j.is.2015.01.010

Recently, permutation based indexes have attracted interest in the area of similarity search. The basic idea of permutation based indexes is that data objects are represented as appropriately generated permutations of a set of pivots (or reference objects). Similarity queries are executed by searching for data objects whose permutation representation is similar to that of the query, following the assumption that similar objects are represented by similar permutations of the pivots. In the context of permutation-based indexing, most authors propose to select pivots randomly from the data set, given that traditional pivot selection techniques do not reveal better performance. However, to the best of our knowledge, no rigorous comparison has been performed yet. In this paper we compare five pivot selection techniques on three permutation-based similarity access methods. Among those, we propose a novel technique specifically designed for permutations. Two significant observations emerge from our tests. First, random selection is always outperformed by at least one of the tested techniques. Second, there is no technique that is universally the best for all permutation-based access methods; rather different techniques are optimal for different methods. This indicates that the pivot selection technique should be considered as an integrating and relevant part of any permutation-based access method.
@article{AMATO2015176,
   title = "A comparison of pivot selection techniques for permutation-based indexing",
   journal = "Information Systems",
   volume = "52",
   pages = "176 - 188",
   year = "2015",
   note = "Special Issue on Selected papers from SISAP 2013",
   issn = "0306-4379",
   doi = "http://dx.doi.org/10.1016/j.is.2015.01.010",
   author = "Giuseppe Amato and Andrea Esuli and Fabrizio Falchi",
}

Efficient Indexing of Regional Maximum Activations of Convolutions using Full-Text Search Engines

G. Amato, F. Carrara, F. Falchi, C. Gennaro

Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval (ICMR '17)

Bucharest, Romania — June 06 - 09, 2017. ACM New York, NY, USA ©2017, Pages 420-423. ISBN: 978-1-4503-4701-3 , Scopus: 2-s2.0-85021827776, DOI: 10.1145/3078971.3079035

In this paper, we adapt a surrogate text representation technique to develop efficient instance-level image retrieval using Regional Maximum Activations of Convolutions (R-MAC). R-MAC features have recently showed outstanding performance in visual instance retrieval. However, contrary to the activations of hidden layers adopting ReLU (Rectified Linear Unit), these features are dense. This constitutes an obstacle to the direct use of inverted indexes, which rely on sparsity of data. We propose the use of deep permutations, a recent approach for efficient evaluation of permutations, to generate surrogate text representation of R-MAC features, enabling indexing of visual features as text into a standard search-engine. The experiments, conducted on Lucene, show the effectiveness and efficiency of the proposed approach.
		
@inproceedings{Amato:2017:EIR:3078971.3079035,
author = {Amato, Giuseppe and Carrara, Fabio and Falchi, Fabrizio and Gennaro, Claudio},
title = {Efficient Indexing of Regional Maximum Activations of Convolutions Using Full-Text Search Engines},
booktitle = {Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval},
series = {ICMR '17},
year = {2017},
isbn = {978-1-4503-4701-3},
location = {Bucharest, Romania},
pages = {420--423},
numpages = {4},
url = {http://doi.acm.org/10.1145/3078971.3079035},
doi = {10.1145/3078971.3079035},
acmid = {3079035},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {deep convolutional neural network, permutation-based indexing, similarity search},
}

Technologies for visual localization and augmented reality in smart cities

G. Amato, F.A. Cardillo, F. Falchi

Sensing the Past: From artifact to historical site

Geotechnologies and the Environment, Volume 16, 2017
Springer International Publishing, Cham (Switzerland), 2017, Pages 419-434
ISBN: 978-3-319-50518-3, eISBN: 78-3-319-50518-3, ISSN: 2365-0575
DOI: 10.1007/978-3-319-50518-3_20

The widespread diffusion of smart devices, such as smartphones and tablets, and the new emerging trend of wearable devices, such as smart glasses and smart watches, has pushed forward the development of applications where the user can interact relying on his or her position and field of view. In this way, users can also receive additional information in augmented reality, that is, seeing the information through the smart device, overlaid on top of the real scene. The GPS or the compass can be used to localize the user when augmented reality has to be provided with scenes of large size, for instance, squares or large buildings. However, when augmented reality has to be offered for enriching the view of small objects or small details of larger objects, for instance, statues, paintings, or epigraphs, a more precise positioning is needed. Visual object recognition and tracking technologies offer very detailed and fine-grained positioning capabilities. This chapter discusses the techniques enabling a precise positioning of the user and the subsequent experience in augmented reality, focusing on algorithms for image matching and homography estimation between the images seen by smart devices and images representing objects of interest.

		
@Inbook{Amato2017,
author="Amato, Giuseppe and Cardillo, Franco Alberto and Falchi, Fabrizio",
editor="Masini, Nicola and Soldovieri, Francesco",
title="Technologies for Visual Localization and Augmented Reality in Smart Cities",
bookTitle="Sensing the Past: From artifact to historical site",
year="2017",
publisher="Springer International Publishing",
address="Cham",
pages="419--434",
isbn="978-3-319-50518-3",
doi="10.1007/978-3-319-50518-3_20",
url="https://doi.org/10.1007/978-3-319-50518-3_20"
}

Visual recognition of ancient inscriptions using convolutional neural network and fisher vector

G. Amato, F. Falchi, L. Vadicamo

Journal on Computing and Cultural Heritage (JOCCH)

Volume 9, Issue 4, December 2016, Article number 21
ACM New York, NY, USA
ISSN: 1556-4673, eISSN: 1556-4711
WOS: 000391726300004 | Scopus: 2-s2.0-85006974335 | DOI: 10.1145/2964911

By bringing together the most prominent European institutions and archives in the field of Classical Latin and Greek epigraphy, the EAGLE project has collected the vast majority of the surviving Greco-Latin inscriptions into a single readily-searchable database. Text-based search engines are typically used to retrieve information about ancient inscriptions (or about other artifacts). These systems require that the users formulate a text query that contains information such as the place where the object was found or where it is currently located. Conversely, visual search systems can be used to provide information to users (like tourists and scholars) in a most intuitive and immediate way, just using an image as query. In this article, we provide a comparison of several approaches for visual recognizing ancient inscriptions. Our experiments, conducted on 17, 155 photos related to 14, 560 inscriptions, show that BoW and VLAD are outperformed by both Fisher Vector (FV) and Convolutional Neural Network (CNN) features. More interestingly, combining FV and CNN features into a single image representation allows achieving very high effectiveness by correctly recognizing the query inscription in more than 90% of the cases. Our results suggest that combinations of FV and CNN can be also exploited to effectively perform visual retrieval of other types of objects related to cultural heritage such as landmarks and monuments.
@article{Amato:2016:VRA:2999570.2964911,
 author = {Amato, Giuseppe and Falchi, Fabrizio and Vadicamo, Lucia},
 title = {Visual Recognition of Ancient Inscriptions Using Convolutional Neural Network and Fisher Vector},
 journal = {J. Comput. Cult. Herit.},
 issue_date = {December 2016},
 volume = {9},
 number = {4},
 month = dec,
 year = {2016},
 issn = {1556-4673},
 pages = {21:1--21:24},
 articleno = {21},
 numpages = {24},
 url = {http://doi.acm.org/10.1145/2964911},
 doi = {10.1145/2964911},
 acmid = {2964911},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {Fisher vector, Latin and Greek inscriptions, convolutional neural network, epigraphy},
} 

Deep Permutations: Deep Convolutional Neural Networks and Permutation-Based Indexing

G. Amato, F. Falchi, C. Gennaro, L. Vadicamo

Similarity Search and Applications: 9th International Conference, SISAP 2016

Location Tokyo, Japan, October 24-26, 2016
Lecture Notes in Computer Science Volume, vol. 9939, Pages 93-106
Springer International Publishing Switzerland (Cham, Switzerland), 2016
ISSN: 0302-9743, ISBN: 978-3-319-46759-7
WOS: 000389801100007 | Scopus: 2-s2.0-84989842652 | DOI: 10.1007/978-3-319-46759-7_7

The activation of the Deep Convolutional Neural Networks hidden layers can be successfully used as features, often referred as Deep Features, in generic visual similarity search tasks. Recently scientists have shown that permutation-based methods offer very good performance in indexing and supporting approximate similarity search on large database of objects. Permutation-based approaches represent metric objects as sequences (permutations) of reference objects, chosen from a predefined set of data. However, associating objects with permutations might have a high cost due to the distance calculation between the data objects and the reference objects. In this work, we propose a new approach to generate permutations at a very low computational cost, when objects to be indexed are Deep Features. We show that the permutations generated using the proposed method are more effective than those obtained using pivot selection criteria specifically developed for permutation-based methods.
@Inbook{Amato2016,
author="Amato, Giuseppe and Falchi, Fabrizio and Gennaro, Claudio
and Vadicamo, Lucia",
title="Deep Permutations: Deep Convolutional Neural Networks and Permutation-Based Indexing",
bookTitle="Similarity Search and Applications: 9th International Conference, SISAP 2016, Tokyo, Japan, October 24-26, 2016, Proceedings",
year="2016",
publisher="Springer International Publishing",
address="Cham",
pages="93--106",
isbn="978-3-319-46759-7",
doi="10.1007/978-3-319-46759-7_7",
url="https://doi.org/10.1007/978-3-319-46759-7_7"
}

Large scale indexing and searching deep convolutional neural network features

G. Amato, F. Debole, F. Falchi, C. Gennaro, F. Rabitti

Big Data Analytics and Knowledge Discovery

18th International Conference, DaWaK 2016
Porto, Portugal, September 6-8, 2016
ISSN: 0302-9743, eISSN: 1611-3349, ISBN: 978-3-319-43945-7
WOS: 000389020800014 | Scopus: 2-s2.0-84981249591 | DOI: 10.1007/978-3-319-43946-4_14

Content-based image retrieval using Deep Learning has become very popular during the last few years. In this work, we propose an approach to index Deep Convolutional Neural Network Features to support efficient retrieval on very large image databases. The idea is to provide a text encoding for these features enabling the use of a text retrieval engine to perform image similarity search. In this way, we built LuQ a robust retrieval system that combines full-text search with content-based image retrieval capabilities. In order to optimize the index occupation and the query response time, we evaluated various tuning parameters to generate the text encoding. To this end, we have developed a web-based prototype to efficiently search through a dataset of 100 million of images.
@Inbook{Amato2016,
author="Amato, Giuseppe and Debole, Franca and Falchi, Fabrizio and Gennaro, Claudio and Rabitti, Fausto",
editor="Madria, Sanjay
and Hara, Takahiro",
title="Large Scale Indexing and Searching Deep Convolutional Neural Network Features",
bookTitle="Big Data Analytics and Knowledge Discovery: 18th International Conference, DaWaK 2016, Porto, Portugal, September 6-8, 2016, Proceedings",
year="2016",
publisher="Springer International Publishing",
address="Cham",
pages="213--224",
isbn="978-3-319-43946-4",
doi="10.1007/978-3-319-43946-4_14",
url="https://doi.org/10.1007/978-3-319-43946-4_14"
}

Car parking occupancy detection using smart camera networks and deep learning

G. Amato, F. Carrara, F. Falchi, C. Gennaro, C. Vairo

2016 IEEE Symposium on Computers and Communication (IEEE ISCC 2016)

27-30 June, 2016, Messina, Italy.
Received the Best Italian paper Award
Institute of Electrical and Electronics Engineers (IEEE) Inc., 2016, pages 1212-1217
ISSN: 15301346, eISBN: 978-1-5090-0679-3, ISBN: 978-1-5090-0680-9
WOS: 000386979000198 | Scopus: 2-s2.0-84985914810 | DOI: 10.1109/ISCC.2016.7543901

This paper presents an approach for real-time car parking occupancy detection that uses a Convolutional Neural Network (CNN) classifier running on-board of a smart camera with limited resources. Experiments show that our technique is very effective and robust to light condition changes, presence of shadows, and partial occlusions. The detection is reliable, even when tests are performed using images captured from a viewpoint different than the viewpoint used for training. In addition, it also demonstrates its robustness when training and tests are executed on different parking lots. We have tested and compared our solution against state of the art techniques, using a reference benchmark for parking occupancy detection. We have also produced and made publicly available an additional dataset that contains images of the parking lot taken from different viewpoints and in different days with different light conditions. The dataset captures occlusion and shadows that might disturb the classification of the parking spaces status.
@INPROCEEDINGS{7543901, 
author={G. Amato and F. Carrara and F. Falchi and C. Gennaro and C. Vairo}, 
booktitle={2016 IEEE Symposium on Computers and Communication (ISCC)}, 
title={Car parking occupancy detection using smart camera networks and Deep Learning}, 
year={2016}, 
pages={1212-1217}, 
doi={10.1109/ISCC.2016.7543901}, 
isbn      = {978-1-5090-0679-3},
publisher = {{IEEE} Computer Society}
}

Picture it in your mind: Generating high level visual representations from textual descriptions

F. Carrara, A. Esuli, T. Fagni, F. Falchi, A.M. Fernández

Presented at the Neu-IR: The SIGIR 2016 Workshop on Neural Information Retrieval, Pisa, July 21, 2016 arXiv:1606.07287

In this paper we tackle the problem of image search when the query is a short textual description of the image the user is looking for. We choose to implement the actual search process as a similarity search in a visual feature space, by learning to translate a textual query into a visual representation. Searching in the visual feature space has the advantage that any update to the translation model does not require to reprocess the, typically huge, image collection on which the search is performed. We propose Text2Vis, a neural network that generates a visual representation, in the visual feature space of the fc6-fc7 layers of ImageNet, from a short descriptive text. Text2Vis optimizes two loss functions, using a stochastic loss-selection method. A visual-focused loss is aimed at learning the actual text-to-visual feature mapping, while a text-focused loss is aimed at modeling the higher-level semantic concepts expressed in language and countering the overfit on non-relevant visual components of the visual loss. We report preliminary results on the MS-COCO dataset.
@article{DBLP:journals/corr/CarraraEFFF16,
  author    = {Fabio Carrara and
               Andrea Esuli and
               Tiziano Fagni and
               Fabrizio Falchi and
               Alejandro Moreo Fern{\'{a}}ndez},
  title     = {Picture It In Your Mind: Generating High Level Visual Representations
               From Textual Descriptions},
  journal   = {CoRR},
  volume    = {abs/1606.07287},
  year      = {2016},
  url       = {http://arxiv.org/abs/1606.07287},
  timestamp = {Wed, 07 Jun 2017 14:43:03 +0200},
  biburl    = {http://dblp.uni-trier.de/rec/bib/journals/corr/CarraraEFFF16},
  bibsource = {dblp computer science bibliography, http://dblp.org}
}

Fast Image Classification for Monument Recognition

G. Amato, F. Falchi, C. Gennaro

Journal on Computing and Cultural Heritage (JOCCH)

Volume 8, Issue 4, December 2015, Article number 18. ACM New York, NY, USA, ISSN: 1556-4673, eISSN: 1556-4711, WOS: 000361070300001 | Scopus: 2-s2.0-84939809955 | DOI: 10.1145/2724727

Content-based image classification is a wide research field that addresses the landmark recognition problem. Among the many classification techniques proposed, the k-nearest neighbor (kNN) is one of the most simple and widely used methods. In this article, we use kNN classification and landmark recognition techniques to address the problem of monument recognition in images. We propose two novel approaches that exploit kNN classification technique in conjunction with local visual descriptors. The first approach is based on a relaxed definition of the local feature based image to image similarity and allows standard kNN classification to be efficiently executed with the support of access methods for similarity search. The second approach uses kNN classification to classify local features rather than images. An image is classified evaluating the consensus among the classification of its local features. In this case, access methods for similarity search can be used to make the classification approach efficient. The proposed strategies were extensively tested and compared against other state-of-the-art alternatives in a monument and cultural heritage landmark recognition setting. The results proved the superiority of our approaches. An additional relevant contribution of this work is the exhaustive comparison of various types of local features and image matching solutions for recognition of monuments and cultural heritage related landmarks.
@article{Amato:2015:FIC:2815168.2724727,
 author = {Amato, Giuseppe and Falchi, Fabrizio and Gennaro, Claudio},
 title = {Fast Image Classification for Monument Recognition},
 journal = {J. Comput. Cult. Herit.},
 issue_date = {August 2015},
 volume = {8},
 number = {4},
 month = aug,
 year = {2015},
 issn = {1556-4673},
 pages = {18:1--18:25},
 articleno = {18},
 numpages = {25},
 url = {http://doi.acm.org/10.1145/2724727},
 doi = {10.1145/2724727},
 acmid = {2724727},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {image classification, kNN classification, local features, object recognition, tourism},
} 

Similarity caching in large-scale image retrieval

F. Falchi, C. Lucchese, S. Orlando, R. Perego, F. Rabitti

Information Processing & Management (IPM)
Volume 48, issue 5, September 2012, pp. 803-818, Elsevier Sci LTD, Oxford, UK

ISSN: 0306-4573, WOS: 000307682100001 | Scopus: s2.0-84864286791 | DOI: 10.1016/j.ipm.2010.12.006

Feature-rich data, such as audio-video recordings, digital images, and results of scientific experiments, nowadays constitute the largest fraction of the massive data sets produced daily in the e-society. Content-based similarity search systems working on such data collections are rapidly growing in importance. Unfortunately, similarity search is in general very expensive and hardly scalable. In this paper we study the case of content-based image retrieval (CBIR) systems, and focus on the problem of increasing the throughput of a large-scale CBIR system that indexes a very large collection of digital images. By analyzing the query log of a real CBIR system available on the Web, we characterize the behavior of users who experience a novel search paradigm, where content-based similarity queries and text-based ones can easily be interleaved. We show that locality and self-similarity is present even in the stream of queries submitted to such a CBIR system. According to these results, we propose an effective way to exploit this locality, by means of a similarity caching system, which stores the results of recently/frequently submitted queries and associated results. Unlike traditional caching, the proposed cache can manage not only exact hits, but also approximate ones that are solved by similarity with respect to the result sets of past queries present in the cache. We evaluate extensively the proposed solution by using the real query stream recorded in the log and a collection of 100 millions of digital photographs. The high hit ratios and small average approximation error figures obtained demonstrate the effectiveness of the approach.
@article{FALCHI2012803,
 author = "Fabrizio Falchi and Claudio Lucchese and Salvatore Orlando and Raffaele Perego and Fausto Rabitti",
 title = "Similarity caching in large-scale image retrieval",
 journal = "Information Processing & Management",
 volume = "48",
 number = "5",
 pages = "803 - 818",
 year = "2012",
 issn = "0306-4573",
 doi = "http://dx.doi.org/10.1016/j.ipm.2010.12.006",
 url = "http://www.sciencedirect.com/science/article/pii/S030645731000107X",
}

Building a web-scale image similarity search system

M. Batko, F. Falchi, C. Lucchese, D. Novak, R. Perego, F. Rabitti, J. Sedmidubsky, P. Zezula

Multimedia Tools and Applications (MTAP)

ISSN: 1380-7501, eISSN: 1573-7721, WOS: 000275800200012 | Scopus: 2-s2.0-77950188067, DOI: 10.1007/s11042-009-0339-z

As the number of digital images is growing fast and Content-based Image Retrieval (CBIR) is gaining in popularity, CBIR systems should leap towards Web-scale datasets. In this paper, we report on our experience in building an experimental similarity search system on a test collection of more than 50 million images. The first big challenge we have been facing was obtaining a collection of images of this scale with the corresponding descriptive features. We have tackled the non-trivial process of image crawling and extraction of several MPEG-7 descriptors. The result of this effort is a test collection, the first of such scale, opened to the research community for experiments and comparisons. The second challenge was to develop indexing and searching mechanisms able to scale to the target size and to answer similarity queries in real-time. We have achieved this goal by creating sophisticated centralized and distributed structures based purely on the metric space model of data. We have joined them together which has resulted in an extremely flexible and scalable solution. In this paper, we study in detail the performance of this technology and its evolvement as the data volume grows by three orders of magnitude. The results of the experiments are very encouraging and promising for future applications.
@Article{Batko2010,
 author="Batko, Michal and Falchi, Fabrizio and Lucchese, Claudio and Novak, David and Perego, Raffaele and Rabitti, Fausto and Sedmidubsky, Jan and Zezula, Pavel",
 title="Building a web-scale image similarity search system",
 journal="Multimedia Tools and Applications",
 year="2010",
 month="May",
 day="01",
 volume="47",
 number="3",
pages="599--629",
 issn="1573-7721",
 doi="10.1007/s11042-009-0339-z",
 url="https://doi.org/10.1007/s11042-009-0339-z"
}

CoPhIR: a Test Collection for Content-Based Image Retrieval

P. Bolettieri, A. Esuli, F. Falchi, C. Lucchese, R. Perego, T. Piccioli, F. Rabitti

CoRR (Computing Research Repository), abs/0905.4627 arXiv, Cornell University Library, 2009, 15 pp.

The scalability, as well as the effectiveness, of the different Content-based Image Retrieval (CBIR) approaches proposed in literature, is today an important research issue. Given the wealth of images on the Web, CBIR systems must in fact leap towards Web-scale datasets. In this paper, we report on our experience in building a test collection of 100 million images, with the corresponding descriptive features, to be used in experimenting new scalable techniques for similarity searching, and comparing their results. In the context of the SAPIR (Search on Audio-visual content using Peer-to-peer Information Retrieval) European project, we had to experiment our distributed similarity searching technology on a realistic data set. Therefore, since no large-scale collection was available for research purposes, we had to tackle the non-trivial process of image crawling and descriptive feature extraction (we used five MPEG-7 features) using the European EGEE computer GRID. The result of this effort is CoPhIR, the first CBIR test collection of such scale. CoPhIR is now open to the research community for experiments and comparisons, and access to the collection was already granted to more than 50 research groups worldwide.
@article{DBLP:journals/corr/abs-0905-4627,
  author    = {Paolo Bolettieri and
               Andrea Esuli and
               Fabrizio Falchi and
               Claudio Lucchese and
               Raffaele Perego and
               Tommaso Piccioli and
               Fausto Rabitti},
  title     = {CoPhIR: a Test Collection for Content-Based Image Retrieval},
  journal   = {CoRR},
  volume    = {abs/0905.4627},
  year      = {2009},
  url       = {http://arxiv.org/abs/0905.4627},
  timestamp = {Wed, 07 Jun 2017 14:40:13 +0200},
  biburl    = {http://dblp.uni-trier.de/rec/bib/journals/corr/abs-0905-4627},
  bibsource = {dblp computer science bibliography, http://dblp.org}
}

Enabling Content-Based Image Retrieval in Very Large Digital Libraries

P. Bolettieri, A. Esuli, F. Falchi, C. Lucchese, R. Perego and F. Rabitti

Proceeding of the Second Workshop on Very Large Digital Libraries, 2 October 2009, Corfu, Greece. DELOS: an Association for Digital Libraries (Pisa, Italy), 2009: pp. 43-50

ISBN: 978-888850685-2

Enabling e ective and e cient Content-Based Image Re- trieval (CBIR) on Very Large Digital Libraries (VLDLs), is today an important research issue. While there exist well-known approaches for information retrieval on textual content for VLDLs, the research for an e ective CBIR method that is also able to scale to very large collections is still open. A practical e ect of this situation is that most of the image retrieval services currently available for VLDLs are based only on tex- tual metadata. In this paper, we report on our experience in creating a collection of 106 million images, i.e., the CoPhIR collection, the largest currently available to the scienti c community for research purposes.We discuss the various issues arising from working with a such large col- lection and dealing with a complex retrieval model on information-rich features. We present the non-trivial process of image crawling and de- scriptive feature extraction, using the European EGEE computer GRID. The feature extraction phase is often ignored when discussing the scala- bility issue while, as we show in this work, it could be one of the toughest issues to be solved in order to make CBIR feasible on VLDLs.
@inproceedings{2009,
  author    = {Paolo Bolettieri and Andrea Eusli and Fabrizio Falchi and Claudio Lucchese and Raffaele Perego and Fausto Rabitti},
  title     = {Enabling Content-Based Image Retrieval in Very Large Digital Libraries},
  booktitle = {Proceeding of the Second Workshop on Very Large Digital Libraries, 2 October 2009, Corfu, Greece},
  pages     = {43-50},
  year      = {2009},
  publisher = {DELOS: an Association for Digital Libraries (Pisa, Italy)},
  isbn      = {978-888850685-2}
}

Distance browsing in distributed multimedia databases

F. Falchi, C. Gennaro, F. Rabitti, P. Zezula

In Future Generation Computer Systems(FGCS) Volume 25, Issue 1 (January 2009), Elsevier Science Publishers B. V. (Amsterdam, The Netherlands), 2009: pp. 64-76. ISSN: 0167-739X

WOS: 000260238300008, Scopus: 2-s2.0-51249094919, DOI: 10.1016/j.future.2008.02.007

The state of the art of searching for non-text data (e.g., images) is to use extracted metadata annotations or text, which might be available as a related information. However, supporting real content-based audiovisual search, based on similarity search on features, is significantly more expensive than searching for text. Moreover, such search exhibits linear scalability with respect to the dataset size, so parallel query execution is needed. In this paper, we present a Distributed Incremental Nearest Neighbor algorithm (DINN) for finding closest objects in an incremental fashion over data distributed among computer nodes, each able to perform its local Incremental Nearest Neighbor (local-INN) algorithm. We prove that our algorithm is optimum with respect to both the number of involved nodes and the number of local-INN invocations. An implementation of our DINN algorithm, on a real P2P system called MCAN, was used for conducting an extensive experimental evaluation on a real-life dataset. The proposed algorithm is being used in two running projects: SAPIR and NeP4B.
@article{FALCHI200964,
 title = "Distance browsing in distributed multimedia databases",
 journal = "Future Generation Computer Systems",
 volume = "25",
 number = "1",
 pages = "64 - 76",
 year = "2009",
 note = "",
 issn = "0167-739X",
 doi = "http://dx.doi.org/10.1016/j.future.2008.02.007",
 url = "http://www.sciencedirect.com/science/article/pii/S0167739X08000186",
 author = "Fabrizio Falchi and Claudio Gennaro and Fausto Rabitti and Pavel Zezula",
}

Scalability comparison of Peer-to-Peer similarity search structures

M. Batko, D. Novak, F. Falchi, P. Zezula

In Future Generation Computer Systems (FGCS) Volume 24, Issue 8 (October 2008), Elsevier Science Publishers B. V. (Amsterdam, The Netherlands), 2008: pp. 834-848. ISSN: 0167-739X

WOS: 000258426100008, Scopus: 2-s2.0-46849117520, DOI: 10.1016/j.future.2007.07.012

Due to the increasing complexity of current digital data, similarity search has become a fundamental computational task in many applications. Unfortunately, its costs are still high and grow linearly on single server structures, which prevents them from efficient application on large data volumes. In this paper, we shortly describe four recent scalable distributed techniques for similarity search and study their performance in executing queries on three different datasets. Though all the methods employ parallelism to speed up query execution, different advantages for different objectives have been identified by experiments. The reported results would be helpful for choosing the best implementations for specific applications. They can also be used for designing new and better indexing structures in the future.
@article{BATKO2008834,
 title = "Scalability comparison of Peer-to-Peer similarity search structures",
 journal = "Future Generation Computer Systems",
 volume = "24",
 number = "8",
 pages = "834 - 848",
 year = "2008",
 note = "",
 issn = "0167-739X",
 doi = "http://dx.doi.org/10.1016/j.future.2007.07.012",
 url = "http://www.sciencedirect.com/science/article/pii/S0167739X0700132X",
 author = "Michal Batko and David Novak and Fabrizio Falchi and Pavel Zezula",
}

Nearest neighbor search in metric spaces through Content-Addressable Networks

F. Falchi, C. Gennaro, P. Zezula

Information Processing and Management (IPM). Volume 44, Issue 1 (2008).
Elsevier Sci LTD, Oxford, UK: pp. 411-429. ISSN: 0306-4573

WOS: 000251441600031, Scopus: 2-s2.0-35549001762, DOI: 10.1016/j.ipm.2007.03.002

Most of the peer-to-peer search techniques proposed in the recent years have focused on the single-key retrieval. However, similarity search in metric spaces represents an important paradigm for content-based retrieval in many applications. In this paper we introduce an extension of the well-known Content-Addressable Network paradigm to support storage and retrieval of more generic metric space objects. In particular we address the problem of executing the nearest neighbors queries, and propose three different algorithms of query propagation. An extensive experimental study on real-life data sets explores the performance characteristics of the proposed algorithms by showing their advantages and disadvantages.
@article{FALCHI2008411,
 title = "Nearest neighbor search in metric spaces through Content-Addressable Networks",
 journal = "Information Processing & Management",
 volume = "44",
 number = "1",
 pages = "411 - 429",
 year = "2008",
 note = "Evaluation of Interactive Information Retrieval Systems",
 issn = "0306-4573",
 doi = "http://dx.doi.org/10.1016/j.ipm.2007.03.002",
 url = "http://www.sciencedirect.com/science/article/pii/S0306457307000763",
 author = "Fabrizio Falchi and Claudio Gennaro and Pavel Zezula"
}

A content–addressable network for similarity search in metric spaces

F. Falchi, C. Gennaro, P. Zezula

In Databases, Information Systems, and Peer-to-Peer Computing, International Workshops, DBISP2P 2005/2006

, Trondheim, Norway, August 28-29, 2005, Seoul, Korea, September 11, 2006, Revised Selected Papers. Lecture Notes in Computer Science, vol. 4125. Springer-Verlag Berlin Heidelberg (Germany), 2007: pp. 98-110. ISBN: 978-3-540-71660-0, ISSN: 0302-9743, WOS: 000246228700009, Scopus: 2-s2.0-38149086079, DOI: 10.1007/978-3-540-71661-7_9

In this paper we present a scalable and distributed access structure for similarity search in metric spaces. The approach is based on the Content-addressable Network (CAN) paradigm, which provides a Distributed Hash Table (DHT) abstraction over a Cartesian space. We have extended the CAN structure to support storage and retrieval of generic metric space objects. We use pivots for projecting objects of the metric space in an N-dimensional vector space, and exploit the CAN organization for distributing the objects among the computing nodes of the structure. We obtain a Peer-to-Peer network, called the MCAN, which is able to search metric space objects by means of the similarity range queries. Experiments conducted on our prototype system confirm full scalability of the approach.
@inproceedings{Falchi:2005:CNS:1783738.1783751,
 author = {Falchi, Fabrizio and Gennaro, Claudio and Zezula, Pavel},
 title = {A Content-addressable Network for Similarity Search in Metric Spaces},
 booktitle = {Proceedings of the 2005/2006 International Conference on Databases, Information Systems, and Peer-to-peer Computing},
 series = {DBISP2P'05/06},
 year = {2007},
 isbn = {978-3-540-71660-0},
 location = {Trondheim, Norway},
 pages = {98--110},
 numpages = {13},
 url = {http://dl.acm.org/citation.cfm?id=1783738.1783751},
 acmid = {1783751},
 publisher = {Springer-Verlag},
 address = {Berlin, Heidelberg},
}

Editorial

Special Section on "Similarity Search and Applications: Selected papers from SISAP 2015"

Edited by G. Amato, R. Connor, F. Falchi and C. Gennaro

Information Systems, Volume 64, March 2017

ISSN: 0306-4379

Similarity Search and Applications

8th International Conference, SISAP 2015, Glasgow, UK, October 12-14, 2015, Proceedings

G. Amato, R. Connor, F. Falchi, C. Gennaro

Lecture Notes in Computer Science, vol. 9371

ISSN: 0302-9743, Print ISBN: 978-3-319-25086-1, Online ISBN: 978-3-319-25087-8
Scopus: 2-s2.0-84951868065, DOI: 10.1007/978-3-319-25087-8

@proceedings{DBLP:conf/sisap/2015,
	  editor    = {Giuseppe Amato and
				   Richard C. H. Connor and
				   Fabrizio Falchi and
				   Claudio Gennaro},
	  title     = {Similarity Search and Applications - 8th International Conference,
				   {SISAP} 2015, Glasgow, UK, October 12-14, 2015, Proceedings},
	  series    = {Lecture Notes in Computer Science},
	  volume    = {9371},
	  publisher = {Springer},
	  year      = {2015},
	  url       = {https://doi.org/10.1007/978-3-319-25087-8},
	  doi       = {10.1007/978-3-319-25087-8},
	  isbn      = {978-3-319-25086-1}
	}

Special track on Engineering Large-Scale Distributed Systems: editorial message

F. Falchi, C. Lucchese

Proceedings of the 2008 ACM symposium on Applied computing (SAC), , Fortaleza, Ceara, Brazil, March 16-20, 2008, vol. I ACM 2008: editorial message, pp. 453-454.

ISBN: 978-1-59593-753-7, Scopus: 2-s2.0-56749175979, DOI: 10.1145/1363686.1363799

@inproceedings{Falchi:2008:STE:1363686.1363799,
 author = {Falchi, Fabrizio and Lucchese, Claudio},
 title = {Special Track on Engineering Large-Scale Distributed Systems: Editorial Message},
 booktitle = {Proceedings of the 2008 ACM Symposium on Applied Computing},
 series = {SAC '08},
 year = {2008},
 isbn = {978-1-59593-753-7},
 location = {Fortaleza, Ceara, Brazil},
 pages = {453--454},
 numpages = {2},
 url = {http://doi.acm.org/10.1145/1363686.1363799},
 doi = {10.1145/1363686.1363799},
 acmid = {1363799},
 publisher = {ACM},
 address = {New York, NY, USA},
}



Other

Towards Multimodal Surveillance For Smart Building Security

G. Amato, P. Barsocchi, F. Falchi, E. Ferro, C. Gennaro, G.R. Leone, D. Moroni, O. Salvetti, C. Vairo
In Proceedings of IWCIM: International Workshop on Computational Intelligence for Multimedia Understanding (IWCIM) at EUSIPCO 2017

The main goal of a surveillance system is to collect information in a sensing environment and notify unexpected behavior. Information provided by single sensor and surveillance technology may not be sufficient to understand the whole context of the monitored environment. On the other hand, by combining information coming from different sources, the overall performance of a surveillance system can be improved. In this paper, we present the Smart Building Suite, in which independent and different technologies are developed in order to realize a multimodal surveillance system.
@inproceedings{IWCIM2017,
 author = {Amato, Giuseppe and Barsocchi, Paolo and Falchi, Fabrizio and Ferro, Erina and Leone, Giuseppe and Moroni, Davide and Salvetti, Ovidio and Vairo, Claudio},
 title = {Towards Multimodal Surveillance For Smart Building Securit},
 booktitle = {Proceedings of IWCIM: International Workshop on Computational Intelligence for Multimedia Understanding},
 isbn = {978-1-4503-5333-5},
}
  

How Data Mining and Machine Learning Evolved from Relational Data Base to Data Science

G. Amato, L. Candela, D. Castelli, A. Esuli, F. Falchi, C. Gennaro, F. Giannotti, A. Monreale, M. Nanni, P. Pagano, L. Pappalardo, D. Pedreschi, F. Pratesi, F. Rabitti, S. Rinzivillo, G. Rossetti, S. Ruggieri, F. Sebastiani, M. Tesconi
A Comprehensive Guide Through the Italian Database Research Over the Last 25 Years. Springer International Publishing, pages 287-306
DOI: 10.1007/978-3-319-61893-7_17

During the last 35 years, data management principles such as physical and logical independence, declarative querying and cost-based optimization have led to profound pervasiveness of relational databases in any kind of organization. More importantly, these technical advances have enabled the first round of business intelligence applications and laid the foundation for managing and analyzing Big Data today.
@Inbook{Amato2018,
  author="Amato, G. and Candela, L. and Castelli, D. and Esuli, A. and Falchi, F. and Gennaro, C. and Giannotti, F. and Monreale, A. and Nanni, M. and Pagano, P. and Pappalardo, L. and Pedreschi, D. and Pratesi, F. and Rabitti, F. and Rinzivillo, S. and Rossetti, G. and Ruggieri, S. and Sebastiani, F. and Tesconi, M.", editor="Flesca, Sergio and Greco, Sergio and Masciari, Elio and Sacc{\`a}, Domenico",
  title="How Data Mining and Machine Learning Evolved from Relational Data Base to Data Science",
  bookTitle="A Comprehensive Guide Through the Italian Database Research Over the Last 25 Years",
  year="2018",
  publisher="Springer International Publishing",
  address="Cham",
  pages="287--306",
  isbn="978-3-319-61893-7",
  doi="10.1007/978-3-319-61893-7_17",
  url="https://doi.org/10.1007/978-3-319-61893-7_17"
}

Searching and annotating 100M Images with YFCC100M-HNfc6 and MI-File

Amato G., Falchi F., Gennaro C., Rabitti F.
CBMI '17 Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing, Article No. 26 Florence, Italy — June 19 - 21, 2017. ACM New York, NY, USA ©2017. ISBN: 978-1-4503-5333-5, DOI: 10.1145/3095713.3095740

We present an image search engine that allows searching by similarity about 100M images included in the YFCC100M dataset, and annotate query images. Image similarity search is performed using YFCC100M-HNfc6, the set of deep features we extracted from the YFCC100M dataset, which was indexed using the MI-File index for efficient similarity searching. A metadata cleaning algorithm, that uses visual and textual analysis, was used to select from the YFCC100M dataset a relevant subset of images and associated annotations, to create a training set to perform automatic textual annotation of submitted queries. The on-line image and annotation system demonstrates the effectiveness of the deep features for assessing conceptual similarity among images, the effectiveness of the metadata cleaning algorithm, to identify a relevant training set for annotation, and the efficiency and accuracy of the MI-File similarity index techniques, to search and annotate using a dataset of 100M images, with very limited computing resources.
@inproceedings{Amato:2017:SAI:3095713.3095740,
 author = {Amato, Giuseppe and Falchi, Fabrizio and Gennaro, Claudio and Rabitti, Fausto},
 title = {Searching and Annotating 100M Images with YFCC100M-HNfc6 and MI-File},
 booktitle = {Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing},
 series = {CBMI '17},
 year = {2017},
 isbn = {978-1-4503-5333-5},
 location = {Florence, Italy},
 pages = {26:1--26:4},
 articleno = {26},
 numpages = {4},
 url = {http://doi.acm.org/10.1145/3095713.3095740},
 doi = {10.1145/3095713.3095740},
 acmid = {3095740},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {Deep Learning, Image Annotation, Image Search},
} 

Preface

G. Amato, R. Connor, F. Falchi, C. Gennaro
In Information Systems (IS), Volume 64, March 2017, Page 151, ISSN: 0306-4379, Elsevier Sci LTD, Oxford, UK. WOS: 000391900000011, Scopus: 2-s2.0-85005801899, DOI: 10.1016/j.is.2016.10.008

@article{AMATO2017151,
   title = "Preface",
   journal = "Information Systems",
   volume = "64",
   pages = "151",
   year = "2017",
   issn = "0306-4379",
   doi = "http://dx.doi.org/10.1016/j.is.2016.10.008",
   author = "Giuseppe Amato and Richard Connor and Fabrizio Falchi and Claudio Gennaro",
}

How Effective Are Aggregation Methods on Binary Features?

G. Amato, F. Falchi, L. Vadicamo
Proceedings of VISAPP 2016 - 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Roma, Italy, February 27-29, 2016, Vol. 4, SciTePress, 2016, Pages 566-573, ISBN: 978-989-758-175-5, DOI: 10.5220/0005719905660573

Surrogate Text Representation (STR) is a profitable solution to efficient similarity search on metric space using conventional text search engines, such as Apache Lucene. This technique is based on comparing the permutations of some reference objects in place of the original metric distance. However, the Achilles heel of STR approach is the need to reorder the result set of the search according to the metric distance. This forces to use a support database to store the original objects, which requires efficient random I/O on a fast secondary memory (such as flash-based storages). In this paper, we propose to extend the Surrogate Text Representation to specifically address a class of visual metric objects known as Vector of Locally Aggregated Descriptors (VLAD). This approach is based on representing the individual sub-vectors forming the VLAD vector with the STR, providing a finer representation of the vector and enabling us to get rid of the reordering phase. The experiments on a publicly available dataset show that the extended STR outperforms the baseline STR achieving satisfactory performance near to the one obtained with the original VLAD vectors.
@inproceedings{visapp16-bf,
 author={Giuseppe Amato and Fabrizio Falchi and Lucia Vadicamo},
 title={How Effective Are Aggregation Methods on Binary Features?},
 booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2016)},
 year={2016},
 pages={566-573},
 doi={10.5220/0005719905660573},
 isbn={978-989-758-175-5},
}

Using Apache Lucene to Search Vector of Locally Aggregated Descriptors

G. Amato, Paolo Bolettieri, Fabrizio Falchi, C. Gennaro, L. Vadicamo
Proceedings of VISAPP 2016 - 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Roma, Italy, February 27-29, 2016, Vol. 4, SciTePress, 2016, Pages 566-573, ISBN: 978-989-758-175-5, DOI: 10.5220/0005722503830392

ABSTRACT
@inproceedings{visapp16-lucene,
author={Giuseppe Amato and Paolo Bolettieri and Fabrizio Falchi and Claudio Gennaro and Lucia Vadicamo},
title={Using Apache Lucene to Search Vector of Locally Aggregated Descriptors},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2016)},
year={2016},
pages={383-392},
doi={10.5220/0005722503830392},
isbn={978-989-758-175-5},
}

Combining Fisher Vector and Convolutional Neural Networks for Image Retrieval

G. Amato, F. Falchi, F. Rabitti, L. Vadicamo
7th Italian Information Retrieval Workshop, IIR 2016; Venezia; Italy; 30 May 2016 through 31 May 2016; Code 123011
CEUR Workshop Proceedings, Volume 1653, 2016, Scopus: 2-s2.0-84985906026, ISSN: 16130073

Fisher Vector (FV) and deep Convolutional Neural Network (CNN) are two popular approaches for extracting effective image representations. FV aggregates local information (e.g., SIFT) and have been state-of-the-art before the recent success of deep learning approaches. Recently, combination of FV and CNN has been investigated. However, only the aggregation of SIFT has been tested. In this work, we propose combining CNN and FV built upon binary local features, called BMM-FV. The results show that BMM-FV and CNN improve the latter retrieval performance with less computational effort with respect to the use of the traditional FV which relies on non-binary features.
@inproceedings{DBLP:conf/iir/AmatoFRV16,
  author    = {Giuseppe Amato and
               Fabrizio Falchi and
               Fausto Rabitti and
               Lucia Vadicamo},
  title     = {Combining Fisher Vector and Convolutional Neural Networks for Image
               Retrieval},
  booktitle = {Proceedings of the 7th Italian Information Retrieval Workshop, Venezia,
               Italy, May 30-31, 2016.},
  year      = {2016},
  series    = {{CEUR} Workshop Proceedings},
  volume    = {1653},
  publisher = {CEUR-WS.org},
  year      = {2016}
}

Indexing 100M Images with Deep Features and MI-File

G. Amato, F. Falchi, C. Gennaro, F. Rabitti
7th Italian Information Retrieval Workshop, IIR 2016; Venezia; Italy; 30 May 2016 through 31 May 2016; Code 123011
CEUR Workshop Proceedings, Volume 1653, 2016, Scopus: 2-s2.0-84985993649

ABSTRACT
@inproceedings{DBLP:conf/iir/AmatoFGR16,
  author    = {Giuseppe Amato and
               Fabrizio Falchi and
               Claudio Gennaro and
               Fausto Rabitti},
  title     = {Indexing 100M Images with Deep Features and MI-File},
  booktitle = {Proceedings of the 7th Italian Information Retrieval Workshop, Venezia,
               Italy, May 30-31, 2016.},
  year      = {2016},
  series    = {{CEUR} Workshop Proceedings},
  volume    = {1653},
  publisher = {CEUR-WS.org},
  year      = {2016}
}

Semiautomatic Learning of 3D Objects from Video Streams

F. Carrara, F. Falchi, C. Gennaro
Similarity Search and Applications, 8th International Conference (SISAP 2015), Glasgow, UK, October 12–14, 2015 Proceedings
Lecture Notes in Computer Science, vol. 9371, pages 217-228 - Springer International Publishing AG Switzerland
ISSN: 0302-9743, Print ISBN: 978-3-319-25086-1, Online ISBN: 978-3-319-25087-8, WOS: 000374289600020, Scopus: 2-s2.0-84951862185, DOI: 10.1007/978-3-319-25087-8_20

@Inbook{Carrara2015,
author="Carrara, Fabio
and Falchi, Fabrizio and Gennaro, Claudio",
editor="Amato, Giuseppe and Connor, Richard and Falchi, Fabrizio
and Gennaro, Claudio",
title="Semiautomatic Learning of 3D Objects from Video Streams",
bookTitle="Similarity Search and Applications: 8th International Conference, SISAP 2015, Glasgow, UK, October 12-14, 2015, Proceedings",
year="2015",
publisher="Springer International Publishing",
address="Cham",
pages="217--228",
isbn="978-3-319-25087-8",
doi="10.1007/978-3-319-25087-8_20",
url="https://doi.org/10.1007/978-3-319-25087-8_20"
}

Searching the EAGLE Epigraphic Material Through Image Recognition via a Mobile Device

P. Bolettieri, V. Casarosa, F. Falchi, L. Vadicamo, P. Martineau, S. Orlandi, R. Santucci
Similarity Search and Applications, 8th International Conference (SISAP 2015), Glasgow, UK, October 12–14, 2015 Proceedings
Lecture Notes in Computer Science, vol. 9371, pages 351-354 - Springer International Publishing AG Switzerland
ISSN: 0302-9743, Print ISBN: 978-3-319-25086-1, WOS: 000374289600035, Scopus: 2-s2.0-84951729513, DOI: 10.1007/978-3-319-25087-8_35

ABSTRACT
@Inbook{Bolettieri2015,
author="Bolettieri, Paolo
and Casarosa, Vittore
and Falchi, Fabrizio
and Vadicamo, Lucia
and Martineau, Philippe
and Orlandi, Silvia
and Santucci, Raffaella",
editor="Amato, Giuseppe
and Connor, Richard
and Falchi, Fabrizio
and Gennaro, Claudio",
title="Searching the EAGLE Epigraphic Material Through Image Recognition via a Mobile Device",
bookTitle="Similarity Search and Applications: 8th International Conference, SISAP 2015, Glasgow, UK, October 12-14, 2015, Proceedings",
year="2015",
publisher="Springer International Publishing",
address="Cham",
pages="351--354",
isbn="978-3-319-25087-8",
doi="10.1007/978-3-319-25087-8_35",
url="https://doi.org/10.1007/978-3-319-25087-8_35"
}

Preface

G. Amato, R. Connor, F. Falchi, C. Gennaro
Similarity Search and Applications, 8th International Conference (SISAP 2015), Glasgow, UK, October 12–14, 2015 Proceedings
Lecture Notes in Computer Science, vol. 9371, pages V-VI - Springer International Publishing AG Switzerland
ISSN: 0302-9743, Print ISBN: 978-3-319-25086-1, Online ISBN: 978-3-319-25087-8, Scopus: 2-s2.0-84951790748,

ABSTRACT
@ARTICLE{2015-SISAP-Preface,
author={Amato, G. and Connor, R. and Falchi, F. and Gennaro, C.},
title={Preface},
journal={Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)},
year={2015},
volume={9371},
pages={V-VI},
note={cited By 0},
url={https://www.scopus.com/inward/record.uri?eid=2-s2.0-84951790748&partnerID=40&md5=fe36f8613207dcabe6cbdf952e57e007},
document_type={Editorial},
source={Scopus},
}

Efficient foreground-background segmentation using local features for object detection

F. Carrara, G. Amato, F. Falchi, C. Gennaro
9th International Conference on Distributed Smart Camera (ICDSC 2015), September 08 - 11, 2015, Seville, Spain - ACM New York, USA: pp. 175-180
ISBN: 978-1-4503-3681-9, Scopus: 2-s2.0-84958251956, DOI: 10.1145/2789116.2789136

ABSTRACT
@inproceedings{Carrara:2015:EFS:2789116.2789136,
 author = {Carrara, Fabio and Amato, Giuseppe and Falchi, Fabrizio and Gennaro, Claudio},
 title = {Efficient Foreground-background Segmentation Using Local Features for Object Detection},
 booktitle = {Proceedings of the 9th International Conference on Distributed Smart Cameras},
 series = {ICDSC '15},
 year = {2015},
 isbn = {978-1-4503-3681-9},
 location = {Seville, Spain},
 pages = {175--180},
 numpages = {6},
 url = {http://doi.acm.org/10.1145/2789116.2789136},
 doi = {10.1145/2789116.2789136},
 acmid = {2789136},
 publisher = {ACM},
 address = {New York, NY, USA},
} 

Visual Recognition in the EAGLE Project

G. Amato, Paolo Bolettieri, Fabrizio Falchi, F. Rabitti, Lucia Vadicamo
6th Italian Information Retrieval Workshop (IIR 2015) Cagliari, Italy, May 25-26, 2015
CEUR Workshop Proceedings, Volume 1404, 2015, Scopus: 2-s2.0-84938526788, ISSN: 1613-0073

ABSTRACT

@inproceedings{DBLP:conf/iir/AmatoBFRV15,
  author    = {Giuseppe Amato and
               Paolo Bolettieri and
               Fabrizio Falchi and
               Fausto Rabitti and
               Lucia Vadicamo},
  title     = {Visual Recognition in the {EAGLE} Project},
  booktitle = {Proceedings of the 6th Italian Information Retrieval Workshop, Cagliari,
               Italy, May 25-26, 2015},
  year      = {2015},
  series    = {{CEUR} Workshop Proceedings},
  volume    = {1404},
  publisher = {CEUR-WS.org},
  year      = {2015},
}


Some Theoretical and Experimental Observations on Permutation Spaces and Similarity Search

G. Amato, Fabrizio Falchi, F. Rabitti, L. Vadicamo
Similarity Search and Applications, 7th International Conference, SISAP 2014, Los Cabos, Mexico, October 29-31, 2014. Proceedings Lecture Notes in Computer Science, vol. 8821, Springer International Publishing, 2014, pp. 37-49 - ISSN: 0302-9743, ISBN: 978-3-319-11987-8
WOS: 000345117600004, Scopus: 2-s2.0-84911192218, DOI: 10.1007/978-3-319-11988-5_4

ABSTRACT
@Inbook{2014-SISAP,
 author="Amato, Giuseppe and Falchi, Fabrizio and Rabitti, Fausto and Vadicamo, Lucia",
 editor="Traina, Agma Juci Machado and Traina, Caetano and Cordeiro, Robson Leonardo Ferreira",
 title="Some Theoretical and Experimental Observations on Permutation Spaces and Similarity Search",
 bookTitle="Similarity Search and Applications: 7th International Conference, SISAP 2014, Los Cabos, Mexico, October 29-31, 2014. Proceedings",
 year="2014",
 publisher="Springer International Publishing",
 address="Cham",
 pages="37--49",
 isbn="978-3-319-11988-5",
 doi="10.1007/978-3-319-11988-5_4",
 url="https://doi.org/10.1007/978-3-319-11988-5_4"
}

Indexing Vectors of Locally Aggregated Descriptors Using Inverted Files

G. Amato, F. Falchi, C. Gennaro, P. Bolettieri
International Conference on Multimedia Retrieval, ICMR '14, Glasgow, United Kingdom - April 01 - 04, 2014. ACM New York, NY, USA 2014: pages 439-442
ISBN: 978-1-4503-2782-4, Scopus: 2-s2.0-84899764244, DOI: 10.1145/2578726.2578788

ABSTRACT
@inproceedings{Amato:2014:IVL:2578726.2578788,
 author = {Amato, Giuseppe and Falchi, Fabrizio and Gennaro, Claudio and Bolettieri, Paolo},
 title = {Indexing Vectors of Locally Aggregated Descriptors Using Inverted Files},
 booktitle = {Proceedings of International Conference on Multimedia Retrieval},
 series = {ICMR '14},
 year = {2014},
 isbn = {978-1-4503-2782-4},
 location = {Glasgow, United Kingdom},
 pages = {439:439--439:442},
 articleno = {439},
 numpages = {4},
 url = {http://doi.acm.org/10.1145/2578726.2578788},
 doi = {10.1145/2578726.2578788},
 acmid = {2578788},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {image classification, landmarks recognition, local features},
} 

Aggregating Local Descriptors for Epigraphs Recognition

G. Amato, Fabrizio Falchi, F. Rabitti, Lucia Vadicamo
In Digital Presentation and Preservation of Cultural and Scientific Heritage, Fourth International Conference Digital Presentation and Preservation of Cultural and Scientific Heritage, DiPP2014 (September 18–21, 2014, Veliko Tarnovo, Bulgaria), Institute of Mathematics and Informatics Bulgarian Academy of Sciences, vol. 4, No 1, (2014), pages 49-58, ISSN: 1314-4006

ABSTRACT
@inproceedings{2014-DiPP,
 author = {Amato, Giuseppe and Falchi, Fabrizio and Rabitti, Fausto and Vadicamo, Lucia},
 title = {Aggregating Local Descriptors for Epigraphs Recognition},
 booktitle = {Digital Presentation and Preservation of Cultural and Scientific Heritage},
 series = {DiPP 2014},
 year = {2014},
 issn = {1314-4006},
 location = {Veliko Tarnovo, Bulgaria},
 pages = {49-58},
 url = {http://sci-gems.math.bas.bg/jspui/handle/10525/2411},
 publisher = {Institute of Mathematics and Informatics Bulgarian Academy of Sciences},
}

Pivot selection strategies for permutation-based similarity search

G. Amato, A. Esuli, F. Falchi
Similarity Search and Applications, 8th International Conference (SISAP 2013)
Lecture Notes in Computer Science, vol. 8199, pages 91-102 - Springer International Publishing AG Switzerland. ISSN 0302-9743, ISBN 978-3-642-41061-1
WOS: 000338111900010, Scopus: 2-s2.0-84886413518, DOI: 10.1007/978-3-642-41062-8_10

ABSTRACT
@Inbook{2013SisapPivot,
 author="Amato, Giuseppe and Esuli, Andrea and Falchi, Fabrizio",
 editor="Brisaboa, Nieves and Pedreira, Oscar and Zezula, Pavel",
 title="Pivot Selection Strategies for Permutation-Based Similarity Search",
 bookTitle="Similarity Search and Applications: 6th International Conference, SISAP 2013, A Coru{\~{n}}a, Spain, October 2-4, 2013, Proceedings",
 year="2013",
 publisher="Springer Berlin Heidelberg",
 address="Berlin, Heidelberg",
 pages="91--102",
 isbn="978-3-642-41062-8",
 doi="10.1007/978-3-642-41062-8_10",
 url="https://doi.org/10.1007/978-3-642-41062-8_10"
}

Large Scale Image Retrieval Using Vector of Locally Aggregated Descriptors

G. Amato, P. Bolettieri, O. Pedreira, P. Zezula
Similarity Search and Applications, 8th International Conference (SISAP 2013)
Lecture Notes in Computer Science, vol. 8199, pages 245-256 - Springer International Publishing AG Switzerland. ISSN 0302-9743, ISBN 978-3-642-41061-1
WOS: 000338111900025, Scopus: 2-s2.0-84981249591, DOI: 10.1007/978-3-642-41062-8_25

ABSTRACT
@Inbook{Amato2013,
 author="Amato, Giuseppe and Bolettieri, Paolo and Falchi, Fabrizio and Gennaro, Claudio",
 editor="Brisaboa, Nieves and Pedreira, Oscar and Zezula, Pavel",
 title="Large Scale Image Retrieval Using Vector of Locally Aggregated Descriptors",
 bookTitle="Similarity Search and Applications: 6th International Conference, SISAP 2013, A Coru{\~{n}}a, Spain, October 2-4, 2013, Proceedings",
 year="2013",
 publisher="Springer Berlin Heidelberg",
 address="Berlin, Heidelberg",
 pages="245--256",
 isbn="978-3-642-41062-8",
 doi="10.1007/978-3-642-41062-8_25",
 url="https://doi.org/10.1007/978-3-642-41062-8_25"
}

On Reducing the Number of Visual Words in the Bag-of-Features Representation

G. Amato, F. Falchi, C. Gennaro
VISAPP 2013 - Proceedings of the International Conference on Computer Vision Theory and Applications, Volume 1, Barcelona, Spain, 21-24 February, 2013, SCITEPRESS – Science and Technology Publications, Portugal, 2013, pages 657-662, ISBN: 978-989-8565-47-1, pages 657-662
Scopus: 2-s2.0-84878259406, DOI: 10.5220/0004290506570662

ABSTRACT
@inproceedings{DBLP:conf/visapp/AmatoFG13,
  author    = {Giuseppe Amato and
               Fabrizio Falchi and
               Claudio Gennaro},
  title     = {On Reducing the Number of Visual Words in the Bag-of-Features Representation},
  booktitle = {{VISAPP} 2013 - Proceedings of the International Conference on Computer
               Vision Theory and Applications, Volume 1, Barcelona, Spain, 21-24
               February, 2013.},
  pages     = {657--662},
  year      = {2013},
  editor    = {Sebastiano Battiato and
               Jos{\'{e}} Braz},
  publisher = {SciTePress},
  year      = {2013},
  doi		= {10.5220/0004290506570662},
  isbn      = {978-989-8565-47-1},
}

Using Visual Attention in a CBIR System - Experimental Results on Landmark and Object Recognition Tasks

F.A. Cardillo, G. Amato, F. Falchi
VISAPP 2013 - Proceedings of the International Conference on Computer Vision Theory and Applications, Volume 1, Barcelona, Spain, 21-24 February, 2013, SCITEPRESS – Science and Technology Publications, Portugal, 2013, pages 468-471, ISBN: 978-989-8565-47-1,
Scopus: 2-s2.0-84878226796, DOI: 10.5220/0004299404680471

ABSTRACT

@inproceedings{DBLP:conf/visapp/CardilloAF13,
  author    = {Franco Alberto Cardillo and
               Giuseppe Amato and
               Fabrizio Falchi},
  title     = {Using Visual Attention in a {CBIR} System - Experimental Results on
               Landmark and Object Recognition Tasks},
  booktitle = {{VISAPP} 2013 - Proceedings of the International Conference on Computer
               Vision Theory and Applications, Volume 1, Barcelona, Spain, 21-24
               February, 2013.},
  pages     = {468--471},
  year      = {2013},
  editor    = {Sebastiano Battiato and
               Jos{\'{e}} Braz},
  publisher = {SciTePress},
  year      = {2013},
  doi		= {10.5220/0004299404680471},
  isbn      = {978-989-8565-47-1},
}

Evaluating inverted files for visual compact codes on a large scale

G. Amato, P. Bolettieri, F. Falchi, C. Gennaro
LSDS-IR: Large-Scale and Distributed Systems for Information Retrieval, 10th Workshop colocated with ACM WSDM 2013

ABSTRACT
@inproceedings{2013-LSDS-IR-Amato,
  author    = {Giuseppe Amato and Paolo Bolettieri and Fabrizio Falchi and Claudio Gennaro},
  title     = {Evaluating inverted files for visual compact codes on a large scale},
  booktitle = {{LSDS-IR} 2013 - 10th international workshop on large-scale and distributed systems for information retrieval (LSDS-IR), co-located with ACM WSDM, Roma, Italy, 5 February, 2013.},
  pages     = {44-49},
  year      = {2013},
  urn 		= {https://pdfs.semanticscholar.org/cb5e/44949138af606e1b39a9603a442e593d9653.pdf#page=44},
}

Automatic Aerial Image Alignment for GeoMemories

G. Amato, Fabrizio Falchi, F. Rabitti, Andrea Marchetti, Maurizio Tesconi
MMEDIA 2013, The Fifth International Conferences on Advances in Multimedia. Venice, Italy, April 21-26, 2013 ISSN: 2308-4448
Scopus: 2-s2.0-84905852103,

In the last few years, aerial and satellite photographs have become more an more important for historical records. The availability of Geographical Information Systems and the increasing number of photos made per year allows very advanced fruition of large number of contents. In this paper we illustrate the GeoMemories approach and we focus on its automatic image alignment architecture. The approach leverages on a set of georeferenced images used as knowledge base. Local features are used in combination with compact codes and space transformation to achieve high level of efficiency.
>@inproceedings{
	  author    = {Giuseppe Amato and Fabrizio Falchi and Fausto Rabitti and Anrea Marchetti and Maurizio Tesconi},
  title     = {Automatic Aerial Image Alignment for GeoMemories},
  booktitle = {MMEDIA 2013, The Fifth International Conferences on Advances in Multimedia},
  pages     = {62-66},
  year      = {2013},
  urn 		= {https://www.thinkmind.org/index.php?view=article&articleid=mmedia_2013_3_30_40065},		
}

On kNN Classification and Local Feature Based Similarity Functions

G. Amato, F. Falchi
In Communications in Computer and Information Science, Volume 271, 2013, revised Selected papers ICAART 2011, Springer-Verlag Berlin Heidelberg (New York, NY, USA)pages 224-239. ISSN 1865-0929, ISBN 978-3-642-29965-0, Scopus: 2-s2.0-84880472773, DOI: 10.1007/978-3-642-29966-7_15

ABSTRACT
@Inbook{Amato2013,
 author="Amato, Giuseppe and Falchi, Fabrizio",
 editor="Filipe, Joaquim and Fred, Ana",
 title="On kNN Classification and Local Feature Based Similarity Functions",
 bookTitle="Agents and Artificial Intelligence: Third International Conference, ICAART 2011, Rome, Italy, January, 28-30, 2011. Revised Selected papers",
 year="2013",
 publisher="Springer Berlin Heidelberg",
 address="Berlin, Heidelberg",
 pages="224--239",
 isbn="978-3-642-29966-7",
 doi="10.1007/978-3-642-29966-7_15",
 url="https://doi.org/10.1007/978-3-642-29966-7_15"
}

Visual Features Selection

G. Amato, F. Falchi, C. Gennaro
4th Italian Information Retrieval Workshop, IIR 2013. Pisa, Italy, January 16-17, 2013, CEUR Workshop Proceedings, Volume 964, 2013, pages 41-44, Scopus: 2-s2.0-84922765206, ISSN: 1613-0073

ABSTRACT
@inproceedings{2016-IIR-FVS,
  author    = {Giuseppe Amato and Fabrizio Falchi and Claudio Gennaro},
  title     = {Visual Features Selection},
  booktitle = {Proceedings of the 4th Italian Information Retrieval Workshop, Pisa,
               Italy, Jan 16-17, 2013.},
  year      = {2013},
  series    = {{CEUR} Workshop Proceedings},
  volume    = {964},
  pages		= {41-44},
  publisher = {CEUR-WS.org},
}

Experimenting a Visual Attention Model in the Context of CBIR Systems

F.A. Cardillo, G. Amato, F. Falchi
4th Italian Information Retrieval Workshop, IIR 2013. Pisa, Italy, January 16-17, 2013, CEUR Workshop Proceedings, Volume 964, 2013, pages 45-56, Scopus: 2-s2.0-84922785036, ISSN: 1613-0073

ABSTRACT
@inproceedings{2013-IIR-Att,
  author    = {Franco Alberto Cardillo and Giuseppe Amato and Fabrizio Falchi},
  title     = {Visual Features Selection},
  booktitle = {Proceedings of the 4th Italian Information Retrieval Workshop, Pisa,
               Italy, Jan 16-17, 2013.},
  year      = {2016},
  series    = {{CEUR} Workshop Proceedings},
  volume    = {964},
  pages		= {45-56},
  publisher = {CEUR-WS.org},
}

Autonomic preservation of access copies of digital contents

W. Allasia, F. Falchi, F. Gallo, C. Meghini
In Proceedings of Memory of the World in the Digital Age: Digitization and Preservation, 26-28 September 2012, Vancouver, BC, Canada, UNESCO, 2012, pages 976-987

ABSTRACT
@inproceedings{2012-UNESCO,
  author    = {Walter Allasia and Fabrizio Falchi and Francesco Gallo and Carlo Meghini},
  title     = {Autonomic preservation of access copies of digital contents},
  booktitle = {Proceedings of Memory of the World in the Digital Age: Digitization and Preservation, 26-28 September 2012, Vancouver, BC, Canada},
  year      = {2012},
  pages    = {976-987},
  publisher = {UNESCO},
}

Landmark Recognition in VISITO Tuscany

G. Amato, F. Falchi, F. Rabitti
In Multimedia for Cultural Heritage, First International Workshop, MM4CH 2011. Modena, Italy, May 3, 2011. Revised Selected papers. Communications in Computer and Information Science, Volume 247, Part 1, pages 1-13, Springer-Verlag Berlin Heidelberg (New York, NY, USA), 2012. ISSN: 1865-0929, ISBN: 978-3-642-27977-5.
WOS: 000309892800001, Scopus: 2-s2.0-84856473133, DOI: 10.1007/978-3-642-27978-2_1

ABSTRACT
@Inbook{Amato2012,
 author="Amato, Giuseppe and Falchi, Fabrizio and Rabitti, Fausto",
 editor="Grana, Costantino and Cucchiara, Rita",
 title="Landmark Recognition in VISITO Tuscany",
 bookTitle="Multimedia for Cultural Heritage: First International Workshop, MM4CH 2011, Modena, Italy, May 3, 2011, Revised Selected papers",
 year="2012",
 publisher="Springer Berlin Heidelberg",
 address="Berlin, Heidelberg",
 pages="1--13",
 isbn="978-3-642-27978-2",
 doi="10.1007/978-3-642-27978-2_1",
 url="https://doi.org/10.1007/978-3-642-27978-2_1"
}

Geometric consistency checks for kNN based image classification relying on local features

G. Amato, F. Falchi, C. Gennaro
In Proceedings of the Fourth International Conference on SImilarity Search and APplications (SISAP 2011), Lipari, Italy, 30 June – 1 July 2011, ACM, New York, NY, USA, 2010, pages 81-88.
ISBN: 978-1-4503-0795-6, Scopus: 2-s2.0-79960951691, DOI: 10.1145/1995412.1995428

ABSTRACT
@inproceedings{Amato:2011:GCC:1995412.1995428,
 author = {Amato, Giuseppe and Falchi, Fabrizio and Gennaro, Claudio},
 title = {Geometric Consistency Checks for kNN Based Image Classification Relying on Local Features},
 booktitle = {Proceedings of the Fourth International Conference on SImilarity Search and APplications},
 series = {SISAP '11},
 year = {2011},
 isbn = {978-1-4503-0795-6},
 location = {Lipari, Italy},
 pages = {81--88},
 numpages = {8},
 url = {http://doi.acm.org/10.1145/1995412.1995428},
 doi = {10.1145/1995412.1995428},
 acmid = {1995428},
 publisher = {ACM},
 address = {New York, NY, USA},
} 

Combining local and global visual feature similarity using a text search engine

G. Amato, P. Bolettieri, F. Falchi, C. Gennaro, F. Rabitti
In Content-Based Multimedia Indexing (CBMI), 9th International Workshop on, Madrid, Spain, 13-15 June 2011. IEEE Computer Society (New York, NY, USA), 2011, pages 49-54.
ISBN: 978-1-61284-432-9, Scopus: 2-s2.0-80052287452, DOI: 10.1109/CBMI.2011.5972519

ABSTRACT
@INPROCEEDINGS{5972519,
author={G. Amato and P. Bolettieri and F. Falchi and C. Gennaro and F. Rabitti},
booktitle={2011 9th International Workshop on Content-Based Multimedia Indexing (CBMI)},
title={Combining local and global visual feature similarity using a text search engine},
year={2011},
pages={49-54},
keywords={content-based retrieval;feature extraction;image retrieval;search engines;text analysis;Lucene retrieval engine;content based retrieval systems;global visual feature similarity;image content processing;local visual feature similarity;text search engine;Feature extraction;Image color analysis;Indexing;Transform coding;Visualization;Vocabulary;Access Methods;Approximate Similarity Search;Lucene},
doi={10.1109/CBMI.2011.5972519},
ISSN={1949-3983},
month={June},}

Landmark recognition in VISITO: VIsual Support to Interactive TOurism in Tuscany

G. Amato, P. Bolettieri, F. Falchi
Proceedings of the 1st ACM International Conference on Multimedia Retrieval, ICMR 2011, Trento, Italy, April 18-20, 2011 ACM New York, NY, USA, 2011: demo paper ID 661. ISBN: 978-1-4503-0336-1
Scopus: 2-s2.0-79959700609, DOI: 10.1145/1991996.1992057

ABSTRACT
@inproceedings{Amato:2011:LRV:1991996.1992057,
 author = {Amato, Giuseppe and Bolettieri, Paolo and Falchi, Fabrizio},
 title = {Landmark Recognition in VISITO: VIsual Support to Interactive TOurism in Tuscany},
 booktitle = {Proceedings of the 1st ACM International Conference on Multimedia Retrieval},
 series = {ICMR '11},
 year = {2011},
 isbn = {978-1-4503-0336-1},
 location = {Trento, Italy},
 pages = {61:1--61:2},
 articleno = {61},
 numpages = {2},
 url = {http://doi.acm.org/10.1145/1991996.1992057},
 doi = {10.1145/1991996.1992057},
 acmid = {1992057},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {classifiation, image classification, interactive tourism, landmarks recognition},
} 

Local Feature based Image Similarity Functions for kNN Classification

G. Amato, F. Falchi
ICAART 2011 - Proceedings of the 3rd International Conference on Agents and Artificial Intelligence, Volume 1 – Artificial Intelligence, Rome, Italy, January 28-30, 2011 Sci-TePress (Portugal), 2011, pp. 157-166. ISBN: 978-989-8425-40-9, DOI: Scopus: 2-s2.0-79960148321
Scopus: 2-s2.0-79960148321, DOI: 10.5220/0003185401570166

ABSTRACT
@InProceedings{icaart11,
 author={Giuseppe Amato and Fabrizio Falchi},
 title={Local Feature based Image Similarity Functions for kNN Classification},
 booktitle={Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
 year={2011},
 pages={157-166},
 publisher={SciTePress},
 organization={INSTICC},
 doi={10.5220/0003185401570166},
 isbn={978-989-8425-40-9},
}

Indexing support vector machines for efficient top-k classification

G. Amato, P. Bolettieri, F. Falchi, F. Rabitti, P. Savino
In Proceedings of MMEDIA - International Conferences on Advances in Multimedia 3rd International Conferences on Advances in Multimedia, MMEDIA 2011; Budapest; Hungary; 17 April 2011 through 22 April 2011. IRARIA, 2011, pages 56-61. ISSN: 23084448 ISBN: 978-161208129-8, Scopus: 2-s2.0-84893309725,

This paper proposes an approach to efficiently execute approximate top-k classification (that is, identifying the best k elements of a class) using Support Vector Machines, in web-scale datasets, without significant loss of effectiveness. The novelty of the proposed approach, with respect to other approaches in literature, is that it allows speeding-up several classifiers, each one defined with different kernels and kernel parameters, by using one single index.
@InProceedings{2011-MMEDIA,
author={Amato, G. and Bolettieri, P. and Falchi, F. and Rabitti, F. and Savino, P.},
title={Indexing support vector machines for efficient top-k classification},
journal={MMEDIA - International Conferences on Advances in Multimedia},
year={2011},
pages={56-61},
}

kNN based image classification relying on local feature similarity

G. Amato, F. Falchi
In Proceedings of the Third International Conference on SImilarity Search and APplications (SISAP 2010), Istanbul, Turkey, 18-19 September 2010. ACM, New York, NY, USA, 2010, ISBN: 978-1-4503-0420-7: pages 101-108. ISBN: 978-1-4503-0420-7
Scopus: 2-s2.0-78649874974, DOI: 10.1145/1862344.1862360

ABSTRACT
@inproceedings{Amato:2010:KBI:1862344.1862360,
 author = {Amato, Giuseppe and Falchi, Fabrizio},
 title = {kNN Based Image Classification Relying on Local Feature Similarity},
 booktitle = {Proceedings of the Third International Conference on SImilarity Search and APplications},
 series = {SISAP '10},
 year = {2010},
 isbn = {978-1-4503-0420-7},
 location = {Istanbul, Turkey},
 pages = {101--108},
 numpages = {8},
 url = {http://doi.acm.org/10.1145/1862344.1862360},
 doi = {10.1145/1862344.1862360},
 acmid = {1862360},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {image classification, image indexing, landmarks, local features, recognition},
} 

Recognizing Landmarks Using Automated Classification Techniques: Evaluation of Various Visual Features

G. Amato, F. Falchi, P. Bolettieri
In Proceedings of the Second International Conferences on Advances in Multimedia (MMEDIA 2010), Athens/Glyfada, Greece, 13-19 June 2010. IEEE Computer Society (New York, NY, USA), 2010: pp. 78-83.
ISBN: 978-0-7695-4068-9, Scopus: 2-s2.0-77955261612, DOI: 10.1109/MMEDIA.2010.20

ABSTRACT
@inproceedings{Amato:2010:RLU:1848647.1848930,
 author = {Amato, Giuseppe and Falchi, Fabrizio and Bolettieri, Paolo},
 title = {Recognizing Landmarks Using Automated Classification Techniques: Evaluation of Various Visual Features},
 booktitle = {Proceedings of the 2010 Second International Conferences on Advances in Multimedia},
 series = {MMEDIA '10},
 year = {2010},
 isbn = {978-0-7695-4068-9},
 pages = {78--83},
 numpages = {6},
 url = {http://dx.doi.org/10.1109/MMEDIA.2010.20},
 doi = {10.1109/MMEDIA.2010.20},
 acmid = {1848930},
 publisher = {IEEE Computer Society},
 address = {Washington, DC, USA},
 keywords = {Image indexing, image classification, recognition, landmarks},
} 

Image classification via adaptive ensembles of descriptor-specific classifiers

T. Fagni, F. Falchi, F. Sebastiani
In Pattern Recognition and Image Analysis: Advances in Mathematical Theory and Applications (PRIA), vol. 20, n. 1 (2010) MAIK Nauka/Interperiodica distributed exclusively by Springer Science+Business Media LLC. pp. 21-28. ISSN: 1054-6618, eISSN: 1555-6212
Scopus: 2-s2.0-77952198723, DOI: 10.1134/S1054661810010025

ABSTRACT
@Article{Fagni2010,
 author="Fagni, T. and Falchi, F. and Sebastiani, F.",
 title="Image classification via adaptive ensembles of descriptor-specific classifiers",
 journal="Pattern Recognition and Image Analysis",
 year="2010",
 month="Mar",
 day="01",
 volume="20",
 number="1",
 pages="21--28",
 issn="1555-6212",
 doi="10.1134/S1054661810010025",
 url="https://doi.org/10.1134/S1054661810010025"
}

Searching 100M Images by Content Similarity

P. Bolettieri, F. Falchi, C. Lucchese, Y. Mass, R. Perego, F. Rabitti, M. Shmueli-Scheuer
In Post-proceedings of the 5th Italian Research Conference on Digital Library Systems - IRCDL 2009, Padova, Italy, January 29-30, 2009. Revised selected papers. DELOS: an Association for Digital Libraries 2009: pp. 88-99. ISBN: 978-88-903541-7-5

ABSTRACT
@inproceedings{DBLP:conf/ircdl/BolettieriFLMPRS09,
  author    = {Paolo Bolettieri and
               Fabrizio Falchi and
               Claudio Lucchese and
               Yosi Mass and
               Raffaele Perego and
               Fausto Rabitti and
               Michal Shmueli{-}Scheuer},
  title     = {Searching 100M Images by Content Similarity},
  booktitle = {Post-proceedings of the Fifth Italian Research Conference on Digital
               Libraries - {IRCDL} 2009, Padova, Italy, 29-30 January 2009},
  pages     = {88--99},
  year      = {2009},
  publisher = {{DELOS:} an Association for Digital Libraries / Department of Information
               Engineering of the University of Padua},
}

Caching content-based queries for robust and efficient image retrieval

F. Falchi, C. Lucchese, S. Orlando, R. Perego, F. Rabitti
Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology (EDBT2009), March 23-26 2009, Saint-Petersburg, Russia. (Extending Database Technology; Vol. 360) ACM, New York, NY, USA, 2009, full paper: pp. 780-790. ISBN: 978-1-60558-422-5
Scopus: 2-s2.0-70349122915, DOI: 10.1145/1516360.1516450

ABSTRACT
@inproceedings{Falchi:2009:CCQ:1516360.1516450,
 author = {Falchi, Fabrizio and Lucchese, Claudio and Orlando, Salvatore and Perego, Raffaele and Rabitti, Fausto},
 title = {Caching Content-based Queries for Robust and Efficient Image Retrieval},
 booktitle = {Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology},
 series = {EDBT '09},
 year = {2009},
 isbn = {978-1-60558-422-5},
 location = {Saint Petersburg, Russia},
 pages = {780--790},
 numpages = {11},
 url = {http://doi.acm.org/10.1145/1516360.1516450},
 doi = {10.1145/1516360.1516450},
 acmid = {1516450},
 publisher = {ACM},
 address = {New York, NY, USA},
}

Adaptive committees of feature-specific classifiers for image classification

T. Fagni, F. Falchi, F. Sebastiani
In Image Mining. Theory and Applications. Proceedings of the 2nd International Workshop on Image Mining Theory and Applications. IMTA-09. In conjunction with VISGRAPP 2009, Lisboa – Portugal, February 2009, INSTICC Press (Portugal), 2009, full paper, pp. 113-122. ISBN: 978-989-8111-42-5
WOS: 000267753900013, Scopus: 2-s2.0-67650548640, DOI: 10.5220/0001968501130122

ABSTRACT
@InProceedings{imta09,
author={Tiziano Fagni and Fabrizio Falchi and Fabrizio Sebastiani},
title={Adaptive Committees of Feature-specific Classifiers for Image Classification},
booktitle={Proceedings of the 2nd International Workshop on Image Mining Theory and Applications - Volume 1: Workshop IMTA, (VISIGRAPP 2009)},
year={2009},
pages={113-122},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001968501130122},
isbn={978-989-8111-80-7},
}

Caching Algorithms for Similarity Search

F. Falchi, C. Lucchese, S. Orlando, R. Perego, F. Rabitti
SEBD 2009, Proceedings of the 17th Italian Symposium on Advanced Database Systems, Camogli (Genova, Italia), June 21-24, 2009 Seneca Edizioni, 2009, extended abstract: pp. 145-152. ISBN: 978-88-6122-154-3, Scopus: 2-s2.0-84893423219

Similarity search in metric spaces is a general paradigm that can be used in several application fields. One of them is content-based image retrieval systems. In order to become an effective complement to traditional Web-scale text-based image retrieval solutions, content-based image retrieval must be efficient and scalable. In this paper we investigate caching the answers to content-based image retrieval queries in metric space, with the aim of reducing the average cost of query processing, and boosting the overall system throughput. Our proposal allows the cache to return approximate answers with acceptable quality guarantee even if the query processed has never been encountered in the past. By conducting tests on a collection of one million high-quality digital photos, we show that the proposed caching techniques can have a significant impact on performance. Moreover, we show that our caching algorithm does not suffer of cache pollution problems due to near-duplicate query objects.
inproceedings{DBLP:conf/sebd/FalchiLOPR09,
  author    = {Fabrizio Falchi and
               Claudio Lucchese and
               Salvatore Orlando and
               Raffaele Perego and
               Fausto Rabitti},
  title     = {Caching Algorithms for Similarity Search},
  booktitle = {Proceedings of the Seventeenth Italian Symposium on Advanced Database
               Systems, {SEBD} 2009, Camogli, Italy, June 21-24, 2009},
  pages     = {145--152},
  publisher = {Edizioni Seneca},
  year      = {2009},
  isbn      = {978-88-6122-154-3},
  timestamp = {Thu, 11 Mar 2010 12:55:33 +0100},
  biburl    = {http://dblp2.uni-trier.de/rec/bib/conf/sebd/2009},
  bibsource = {dblp computer science bibliography, http://dblp.org}
}

A metric cache for similarity search

F. Falchi, C. Lucchese, S. Orlando, R. Perego, F. Rabitti
In International Conference on Information and Knowledge Management. Proceeding of the 2008 ACM Workshop on Large-Scale distributed systems for information retrieval (LSDS-IR'08), Napa Valley, California, USA, October 30, 2008. ACM (New York, NY, USA), 2008: full paper, pp. 43-50.

ISBN: 978-1-60558-254-2, Scopus: 2-s2.0-84893423219, DOI: 10.1145/1458469.1458473

ABSTRACT
@inproceedings{Falchi:2008:MCS:1458469.1458473,
 author = {Falchi, Fabrizio and Lucchese, Claudio and Orlando, Salvatore and Perego, Raffaele and Rabitti, Fausto},
 title = {A Metric Cache for Similarity Search},
 booktitle = {Proceedings of the 2008 ACM Workshop on Large-Scale Distributed Systems for Information Retrieval},
 series = {LSDS-IR '08},
 year = {2008},
 isbn = {978-1-60558-254-2},
 location = {Napa Valley, California, USA},
 pages = {43--50},
 numpages = {8},
 url = {http://doi.acm.org/10.1145/1458469.1458473},
 doi = {10.1145/1458469.1458473},
 acmid = {1458473},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {content-based retrieval, metric spaces, query-result caching},

Audio-visual content analysis in P2P networks: the SAPIR approach

W. Allasia, F. Falchi, F. Gallo, M. Kacimi, A. Kaplan, J. Mamou, Y. Mass, N. Orio
In Proceedings of 19th International Conference on Database and Expert Systems Application - DEXA 2008 (1-5 September, 2008). First International Workshop on Automated Information Extraction in Media Production - AIEMPro'08, IEEE Computer Society (New York, NY, USA), Turin, Italy, September 01-05, 2008: full paper, pp. 610-614. ISBN: 0-7695-3030-3, ISSN: 1529-4188. WOS: 000259487400103, Scopus: 2-s2.0-57849156290, DOI: 10.1109/DEXA.2008.123

ABSTRACT
@INPROCEEDINGS{4624785,
 author={W. Allasia and F. Falchi and F. Gallo and M. Kacimi and A. Kaplan and J. Mamou and Y. Mass and N. Orio},
 booktitle={2008 19th International Workshop on Database and Expert Systems Applications},
 title={Audio-Visual Content Analysis in P2P Networks: The SAPIR Approach},
 year={2008},
 pages={610-614},
 doi={10.1109/DEXA.2008.123},
 ISSN={1529-4188},
 month={Sept},}

Using MPEG-7 for Automatic Annotation of Audiovisual Content in eLearning Digital Libraries

G. Amato, P. Bolettieri, F. Debole, F. Falchi, C. Gennaro, F. Rabitti
In Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems, IRCDL 2008, Padova, Italy, January 24-25, 2008 DELOS: an Association for Digital Libraries 2008: full paper, pp. 1-12.

ABSTRACT
@inproceedings{DBLP:conf/ircdl/AmatoBDFGR08,
  author    = {Giuseppe Amato and Paolo Bolettieri and Franca Debole and Fabrizio Falchi and Claudio Gennaro and Fausto Rabitti},
  title     = {Using {MPEG-7} for Automatic Annotation of Audiovisual Content in eLearning Digital Libraries},
  booktitle = {Post-proceedings of the Forth Italian Research Conference on Digital Library Systems, {IRCDL} 2008, Padova, Italy, 24-25 January 2008},
  pages     = {1--12},
  editor    = {Maristella Agosti and Floriana Esposito and Costantino Thanos},
  publisher = {{DELOS:} an Association for Digital Libraries},
  year      = {2008}
}

Crawling, indexing, and similarity searching images on the web

M. Batko, F. Falchi, C. Lucchese, D. Novak, R. Perego, F. Rabitti, J. Sedmidubsky, P. Zezula
In SEBD 2008, Proceedings of the 16th Italian Symposium on Advanced Database Systems (Mondello, June 22-25, 2008 Fotograf (Palermo, Italy, 2008), 2008: extended abstract, pp. 382-389. Scopus: 2-s2.0-84864285637,

ABSTRACT
@INPROCEEDINGS{Batko08crawling,indexing,,
    author = {M. Batko and F. Falchi and C. Lucchese and D. Novak and R. Perego and F. Rabitti and J. Sedmidubsky and P. Zezula},
    title = {Crawling, indexing, and similarity searching images on the web},
    booktitle = {In Proceedings of SEDB ’08, the 16th Italian Symposium on Advanced Database Systems},
    year = {2008},
    pages = {382--389}
}

Efficient video-stream filtering

F. Falchi, C. Gennaro, P. Savino, P. Stanchev
In IEEE Multimedia Volume 15, No. 1 (Janury 2008). IEEE Computer Society (New York, NY, USA), 2008: pp. 52-62. ISSN: 1070-986X, WOS: 000253852700007, Scopus: 2-s2.0-42349091931, DOI: 10.1109/MMUL.2008.6

ABSTRACT
@ARTICLE{4476273,
author={F. Falchi and C. Gennaro and P. Savino and P. Stanchev},
journal={IEEE MultiMedia},
title={Efficient Video-Stream Filtering},
year={2008},
volume={15},
number={1},
pages={52-62},
keywords={information filtering;multimedia computing;video streaming;information filtering;metric distance;video content representation;video-stream filtering;Councils;Information filtering;Information filters;Information science;Layout;MPEG 7 Standard;Nonlinear filters;Space technology;Streaming media;TV;MPEG-7;information filtering;metric space;pivot filtering;similarity search},
doi={10.1109/MMUL.2008.6},
ISSN={1070-986X},
month={Jan},}

An Innovative Approach for Indexing and Searching Digital Rights

W. Allasia, F. Chiariglione, F. Falchi, F. Gallo
In Third International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution (AXMEDIS'07) Barcelona, Spain, 28-30 November 2007 IEEE Computer Society (Los Alamitos, CA), 2007: full paper, pp. 147-154. Scopus: 2-s2.0-47849111213, DOI: 10.1109/AXMEDIS.2007.17

ABSTRACT
@INPROCEEDINGS{4402871,
author={W. Allasia and F. Gallo and F. Chiariglione and F. Falchi},
booktitle={Automated Production of Cross Media Content for Multi-Channel Distribution, 2007. AXMEDIS '07. Third International Conference on},
title={An Innovative Approach for Indexing and Searching Digital Rights},
year={2007},
pages={147-154},
keywords={database indexing;meta data;query formulation;centralized systems;indexing;metadata management;searching digital rights;similarity searches;text searches;Conference management;Content management;Indexing;Information management;Innovation management;Intellectual property;Licenses;Production systems;Streaming media;Video sharing},
doi={10.1109/AXMEDIS.2007.17},
month={Nov},}

SAPIR: Scalable and Distributed Image Searching

F. Falchi, M. Kacimi, Y. Mass, F. Rabitti, P. Zezula
In the Second International Conference on Semantic and Digital Media Technologies (SAMT 2007), Genova, Italy, 5-7 December 2007, Poster and Demo ProceedingsProceedings: demo paper, pp. 11-12. CEUR Workshop Proceedings, Volume 300, 2007. ISSN: 1613-0073, Scopus: 2-s2.0-79960115383,

ABSTRACT
@inproceedings{DBLP:conf/samt/FalchiKMRZ07,
  author    = {Fabrizio Falchi and
               Mouna Kacimi and
               Yosi Mass and
               Fausto Rabitti and
               Pavel Zezula},
  title     = {{SAPIR:} Scalable and Distributed Image Searching},
  booktitle = {Poster and Demo Proceedings of the 2nd International Conference on
               Semantic and Digital Media Technologies, Genoa, Italy, December 5-7,
               2007},
  year      = {2007},
  crossref  = {DBLP:conf/samt/2007p},
  url       = {http://ceur-ws.org/Vol-300/p06.pdf},
  timestamp = {Mon, 30 May 2016 16:57:35 +0200},
  biburl    = {http://dblp.uni-trier.de/rec/bib/conf/samt/FalchiKMRZ07},
  bibsource = {dblp computer science bibliography, http://dblp.org}
}

Automatic metadata extraction and indexing for reusing e-learning multimedia objects

P. Bolettieri, F. Falchi, C. Gennaro, F. Rabitti
In MS '07: Workshop on multimedia information retrieval on The many faces of multimedia semantics (ACM Multimedia 2007) ACM (New York, NY, USA), 2007: pp. 21-28. ISBN: 978-1-59593-782-7, Scopus: 2-s2.0-37849006464, DOI: 10.1145/1290067.1290072

ABSTRACT
@inproceedings{Bolettieri:2007:AME:1290067.1290072,
 author = {Bolettieri, Paolo and Falchi, Fabrizio and Gennaro, Claudio and Rabitti, Fausto},
 title = {Automatic Metadata Extraction and Indexing for Reusing e-Learning Multimedia Objects},
 booktitle = {Workshop on Multimedia Information Retrieval on The Many Faces of Multimedia Semantics},
 series = {MS '07},
 year = {2007},
 isbn = {978-1-59593-782-7},
 location = {Augsburg, Bavaria, Germany},
 pages = {21--28},
 numpages = {8},
 url = {http://doi.acm.org/10.1145/1290067.1290072},
 doi = {10.1145/1290067.1290072},
 acmid = {1290072},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {MPEG-7, automatic extraction, metadata, multimedia content management system, similarity search, user interface},
} 

A digital rights aware similarity measure for multimedia documents

W. Allasia, F. Falchi, F. Gallo, N. Orio
In MS '07: Workshop on multimedia information retrieval on The many faces of multimedia semantics (ACM Multimedia 2007) ACM (New York, NY, USA), 2007: pp. 73-80. ISBN: 978-1-59593-782-7, Scopus: 2-s2.0-37849048715, DOI: 10.1145/1290067.1290080

ABSTRACT
@inproceedings{Allasia:2007:DRA:1290067.1290080,
 author = {Allasia, Walter and Falchi, Fabrizio and Gallo, Francesco and Orio, Nicola},
 title = {A Digital Rights Aware Similarity Measure for Multimedia Documents},
 booktitle = {Workshop on Multimedia Information Retrieval on The Many Faces of Multimedia Semantics},
 series = {MS '07},
 year = {2007},
 isbn = {978-1-59593-782-7},
 location = {Augsburg, Bavaria, Germany},
 pages = {73--80},
 numpages = {8},
 url = {http://doi.acm.org/10.1145/1290067.1290080},
 doi = {10.1145/1290067.1290080},
 acmid = {1290080},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {digital rights, information retrieval, metric spaces, multimedia information systems},
} 

A distributed incremental nearest neighbor algorithm

F. Falchi, C. Gennaro, F. Rabitti, P. Zezula
In Proceedings of the 2nd international conference on Scalable information systems (Infoscale'07) June 6-8, 2007 Suzhou, China ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering) ICST, Brussels, Belgium, Belgium, 2007: full paper, article No. 82. ISBN: 978-1-59593-757-5 Scopus: 2-s2.0-78349246995, DOI: 10.1145/1366804.1366910

ABSTRACT
@inproceedings{Falchi:2007:DIN:1366804.1366910,
 author = {Falchi, Fabrizio and Gennaro, Claudio and Rabitti, Fausto and Zezula, Pavel},
 title = {A Distributed Incremental Nearest Neighbor Algorithm},
 booktitle = {Proceedings of the 2Nd International Conference on Scalable Information Systems},
 series = {InfoScale '07},
 year = {2007},
 isbn = {978-1-59593-757-5},
 location = {Suzhou, China},
 pages = {82:1--82:10},
 articleno = {82},
 numpages = {10},
 url = {http://dl.acm.org/citation.cfm?id=1366804.1366910},
 acmid = {1366910},
 publisher = {ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering)},
 address = {ICST, Brussels, Belgium, Belgium},
 keywords = {distributed systems},
}

Florentine Coats of Arms on the Web: Experimenting retrieval based on text or image content

Falchi, F. Rabitti, W. Schweibenz, J. Simane
In Open Innovation. Neue Perspektiven im Kontext von Information und Wissen. Beiträge des 10. Internationalen Symposiums für Informationswissenschaft (ISI 2007) und der 13. Jahrestagung der IuK-Initiative Wissenschaft, Köln, 30. Mai - 1. Juni 2007. Hrsg. von Achim Oßwald. (Schriften zur Informationswissenschaft 46). Konstanz: UKV. 1-13. ISBN: 978-3-86764-020-6

ABSTRACT
@inproceedings{2007-ISI-Falchi
 author = {Falchi, Fabrizio and Rabitti, Fausto and Schweibenz, Werner and Simane, Jan},
 title = {Florentine Coats of Arms on the Web: Experimenting retrieval based on text or image content},
 booktitle = {Open Innovation. Neue Perspektiven im Kontext von Information und Wissen. Beiträge des 10. Internationalen Symposiums für Informationswissenschaft (ISI 2007) und der 13. Jahrestagung der IuK-Initiative Wissenschaft},
 year = {2007},
 isbn = {978-3-86764-020-6},
 location = {Koln, Germany},
 }

A digital library framework for reusing e-learning video documents

P. Bolettieri, F. Falchi, C. Gennaro, F. Rabitti
In Creating New Learning Experiences on a Global Scale. Second European Conference on Technology Enhanced Learning, EC-TEL 2007, Crete, Greece, September 17-20, 2007. Proceedings, Lecture Notes in Computer Science, vol. 4753 Springer-Verlag Berlin Heidelberg (Germany), 2007: short paper, pp. 444-449. ISSN: 0302-9743 , ISBN: 978-3-540-75194-6, WOS: 000249725200035, Scopus: 2-s2.0-38349001450, DOI: 10.1007/978-3-540-75195-3_35

ABSTRACT
@Inbook{Bolettieri2007,
author="Bolettieri, Paolo and Falchi, Fabrizio and Gennaro, Claudio and Rabitti, Fausto",
editor="Duval, Erik and Klamma, Ralf and Wolpers, Martin",
title="A Digital Library Framework for Reusing e-Learning Video Documents",
bookTitle="Creating New Learning Experiences on a Global Scale: Second European Conference on Technology Enhanced Learning, EC-TEL 2007, Crete, Greece, September 17-20, 2007. Proceedings",
year="2007",
publisher="Springer Berlin Heidelberg",
address="Berlin, Heidelberg",
pages="444--449",
abstract="The objective of this paper is to demonstrate the reuse of digital content, as video documents or PowerPoint presentations, by exploiting existing technologies for automatic extraction of metadata (OCR, speech recognition, cut detection, MPEG-7 visual descriptors, etc.). The multimedia documents and the extracted metadata are then indexed and managed by the Multimedia Content Management System (MCMS) MILOS, specifically developed to support design and effective implementation of digital library applications. As a result, the indexed digital material can be retrieved by means of content based retrieval on the text extracted and on the MPEG-7 visual descriptors (via similarity search), assisting the user of the e-Learning Library (student or teacher) to retrieve the items not only on the basic bibliographic metadata (title, author, etc.).",
isbn="978-3-540-75195-3",
doi="10.1007/978-3-540-75195-3_35",
url="https://doi.org/10.1007/978-3-540-75195-3_35"
}

A Similarity Approach on Searching for Digital Rights

W. Allasia, F. Falchi, F. Gallo
Proceedings of I-MEDIA'07 and I-SEMANTICS ’07, International Conferences on New Media Technology and Semantic Systems. as part of TRIPLE-I 2007 (Graz, Austria, September 5-7, 2007) - 7th Workshop of the Multimedia Metadata Applications (M3A) - Journal of Universal computer Science. ISSN: 0948-695x.

ABSTRACT
@inproceedings{Allasia_asimilarity,
 author = {Walter Allasia and Fabrizio Falchi and Francesco Gallo},
 title = {A Similarity Approach on Searching for Digital Rights},
 year = {2007},
 booktitle = {Proceedings of I-MEDIA'07 and I-SEMANTICS ’07, International Conferences on New Media Technology and Semantic Systems.
				as part of TRIPLE-I 2007},
 year = {2006},
 issn = {0948-695x},
 publisher = {Know-Center},
}
	
}

Using MILOS to build a multimedia digital library application: The photobook experience

G. Amato, P. Bolettieri, F. Debole, F. Falchi, F. Rabitti, P. Savino
In Research and Advanced Technology for Digital Libraries, 10th European Conference on Digital Libraries, ECDL 2006, Alicante, Spain, September 17-22, 2006, Proceedings. Lecture Notes in Computer Science, vol. 4172 Springer-Verlag Berlin Heidelberg (Germany, 2006): full paper, pp. 379-390. ISBN: 3-540-44636-2, ISSN: 0302-9743,
WOS: 000241101500032, Scopus: 2-s2.0-33750230441, DOI: 10.1007/11863878_32

ABSTRACT
@Inbook{Amato2006,
author="Amato, Giuseppe and Bolettieri, Paolo and Debole, Franca and Falchi, Fabrizio and Rabitti, Fausto and Savino, Pasquale",
editor="Gonzalo, Julio and Thanos, Costantino and Verdejo, M. Felisa and Carrasco, Rafael C.",
title="Using MILOS to Build a Multimedia Digital Library Application: The PhotoBook Experience",
bookTitle="Research and Advanced Technology for Digital Libraries: 10th European Conference, ECDL 2006, Alicante, Spain, September 17-22, 2006. Proceedings",
year="2006",
publisher="Springer Berlin Heidelberg",
address="Berlin, Heidelberg",
pages="379--390",
isbn="978-3-540-44638-5",
doi="10.1007/11863878_32",
url="https://doi.org/10.1007/11863878_32"
}

On scalability of the similarity search in the world of peers

M. Batko, F. Falchi, D. Novak, P. Zezula
In Proceedings of the 1st international conference on Scalable information systems (InfoScale '06) Hong Kong (China), May 30 – June 1, 2006. ACM (New York, NY, USA), 2006: full paper, article No. 20 ISBN: 1-59593-428-6, Scopus: 2-s2.0-34547411435, DOI: 10.1145/1146847.1146867

ABSTRACT
@inproceedings{Batko:2006:SSS:1146847.1146867,
 author = {Batko, Michal and Novak, David and Falchi, Fabrizio and Zezula, Pavel},
 title = {On Scalability of the Similarity Search in the World of Peers},
 booktitle = {Proceedings of the 1st International Conference on Scalable Information Systems},
 series = {InfoScale '06},
 year = {2006},
 isbn = {1-59593-428-6},
 location = {Hong Kong},
 articleno = {20},
 url = {http://doi.acm.org/10.1145/1146847.1146867},
 doi = {10.1145/1146847.1146867},
 acmid = {1146867},
 publisher = {ACM},
 address = {New York, NY, USA},
}

Using MILOS to build an on-line photo album: the PhotoBook

G. Amato, P. Bolettieri, F. Debole, F. Falchi, F. Rabitti, P. Savino
In SEBD 2006: Fourteenth Italian Symposium on Database Systems – (Portonovo, Italy, June 18-21, 2006): full paper, pp. 233-240. ISBN: 88-6068-018-2. Scopus: 2-s2.0-84893266139,

ABSTRACT
@INPROCEEDINGS{2006-SEBD-Falchi,
    author = {G. Amato and P. Bolettieri and F. Debole and F. Falchi and F. Rabitti and P. Savino},
    title = {CUsing MILOS to build an on-line photo album: the PhotoBook},
    booktitle = {In Proceedings of SEDB ’06, the 14th Italian Symposium on Advanced Database Systems},
    year = {2006},
    pages = {232-240}
}

Selection of MPEG-7 image features for improving image similarity search on specific data sets

P.L. Stanchev, G. Amato, F. Falchi, C. Gennaro, F. Rabitti, and P. Savino
Proceedings of the Seventh IASTED International Conference on Computer Graphics and Imaging (CGIM 2004), August 17-19, 2004, Kauai, Hawaii, USA, pp. 395-400 International Association of Science and Technology for Development – IASTED Acta Press ISBN: 0-88986-418-7, ISSN: 1482-7905, WOS: 000228521000067, Scopus: 2-s2.0-10444268921,

ABSTRACT
@INPROCEEDINGS{Stanchev04selectionof,
    author = {Peter L. Stanchev},
    title = {Selection of mpeg-7 image features for improving image similarity search on specific data sets},
    booktitle = {In Proc. 7-th IASTED Int’l Conf. on Computer Graphics and Imaging},
    year = {2004},
    pages = {395--400}
}

Improving image similarity search effectiveness in a multimedia content management system

G. Amato, F. Falchi, C. Gennaro, F. Rabitti, P. Savino, P. Stanchev
In MIS 2004: proceedings of the 10th Workshop on Multimedia Information Systems, August 2004: pp. 139-146.

ABSTRACT
@INPROCEEDINGS{Falchi_improvingimage,
    author = {Fabrizio Falchi and Claudio Gennaro and Fausto Rabitti and Pasquale Savino and Peter L. Stanchev},
    title = {Improving image similarity search effectiveness in a multimedia content management system},
    booktitle = {in Proc. of Workshop on Multimedia Information System (MIS), 2004},
    year = {},
    pages = {139--146}
}


PhD Thesis

A Content-Addressable Network for Similarity Search in Metric Spaces

F. Falchi

Joint PhD Università degli Studi di Pisa, Ingegneria dell'Informazione and Masaryk University, Faculty of Informatics, Brno.

Because of the ongoing digital data explosion, more advanced search paradigms than the traditional exact match are needed for contentbased retrieval in huge and ever growing collections of data produced in application areas such as multimedia, molecular biology, marketing, computer-aided design and purchasing assistance. As the variety of data types is fast going towards creating a database utilized by people, the computer systems must be able to model human fundamental reasoning paradigms, which are naturally based on similarity. The ability to perceive similarities is crucial for recognition, classification, and learning, and it plays an important role in scientific discovery and creativity. Recently, the mathematical notion of metric space has become a useful abstraction of similarity and many similarity search indexes have been developed. In this thesis, we accept the metric space similarity paradigm and concentrate on the scalability issues. By exploiting computer networks and applying the Peer-to-Peer communication paradigms, we build a structured network of computers able to process similarity queries in parallel. Since no centralized entities are used, such architectures are fully scalable. Specifically, we propose a Peer-to-Peer system for similarity search in metric spaces called Metric Content-Addressable Network (MCAN) which is an extension of the well known Content-Addressable Network (CAN) used for hash lookup. A prototype implementation of MCAN was tested on real-life datasets of image features, protein symbols, and text — observed results are reported. We also compared the performance of MCAN with three other, recently proposed, distributed data structures for similarity search in metric spaces.

@phdthesis{FalchiPhDThesis,
  author = "Fabrizio Falchi",
  title = "A Content-Addressable Network for Similarity Search in Metric Spaces",
  school "University of Pisa, Ingegneria dell'Informazione and Masaryk University, Faculty of Informatics, Brno",
  supervisor = "Lopriore, Lanfranco and Zezula, Pavel and Rabitti, Fausto",
  year = 2007,
  month = 5,
}


Project Deliverables

Strumenti per la classificazione ed annotazione automatica delle immagini
Editor: F. Falchi, Authors: G. Amato, F. Falchi, P. Bolettieri
VISITO Tuscany, A4.2, 31 May 2011

Sviluppo componente per la ricerca efficiente di immagini
Editor: F. Falchi, Authors: G. Amato, P. Bolettieri, F. Falchi, C. Gennaro
VISITO Tuscany, A4.3, 28 February 2011

Sviluppo componente per il matching approssimato di immagini
Editor: F. Falchi, Authors: G. Amato, F. Falchi, P. Bolettieri
VISITO Tuscany, A4.1, 30 September 2010

Lo stato dell'arte: tecnologia ed utenti
Editor: F. Falchi, Authors: F. Falchi, V. Ippolito, D. Loschiavo, C. Lucchese, F. Lungarotti, A. Melani, S. Minelli, S. Pialli, S. Rossi, S. Salvadori, R. Scartoni, R. Scopigno, F. Tavanti, F. la Torre, R. Venturini
VISITO Tuscany, A1.1.1, 23 February 2010, A1.1.2, 30 September 2010, A1.1.3, 31 May 2011

The ASSETS API
C. Meghini, F. Alberto Cardillo, A. Esuli, F. Falchi, D. Ceccarelli, P. Bolettieri, N. Aloia, C. Concordia, V. Valdés, F. López, J.M. Martínez, J. Bescós, P. Castells, M.A. García, O. Paytuvi, M. Lazaridis, A. Beloued, N. Spyratos, T. Sugibuchi
ASSETS (Advanced Search Services and Enhanced Technological Solutions for the European Digital Library), D.2.0.4

Interface Specifications and System Design
L. Briguglio, S. Gordea, A. Lindley, E. Tzoannos, C. Meghini, F.A. Cardillo, A. Esuli, F. Falchi, D. Ceccarelli, P. Bolettieri, N. Aloia, C. Concordia, V. Valdes, O. Paytuvi, M. Lazaridis, A. Beloued, N. Spyratos, T. Sugibuchi
ASSETS (Advanced Search Services and Enhanced Technological Solutions for the European Digital Library), D.2.0.2

Executing complex similarity queries over multi layer P2P search structures
Editor: F. Falchi Authors: M. Batko, F. Falchi
SAPIR (Search In Audio Visual Content Using Peer-to-Peer IR), D.5.4

Design of the P2P Similarity Based Indexing Technique PDF
Editor: Fabrizio Falchi, Raffaele Perego Authors: M. Batko, F. Falchi, R. Perego, P. Zezula
SAPIR (Search In Audio Visual Content Using Peer-to-Peer IR), D.4.1

Common Schema for Feature Extraction PDF
Editor: A. Kaplan, Authors: A. Kaplan, W. Allasia, F. Falchi, F. Gallo, C. Hagège, J. Mamou, Y. Mass, R. Miotto, N. Orio
SAPIR (Search In Audio Visual Content Using Peer-to-Peer IR), D.3.1

Feature Extraction Modules for Audio, Video, Music, and Text PDF
Editor: A. Kaplan, Authors: P. Bolettieri, F. Falchi, C. Lucchese, W. Allasia, F. Gallo, J. Mamou, B. Sznajder, R. Miotto, N. Orio, C. Brun, J.M. Coursimault, C. Hagège, A. Kaplan
SAPIR (Search In Audio Visual Content Using Peer-to-Peer IR), D.3.2 D3.3 D3.4 D3.5

Design of Techniques for Caching and Replicas Management on P2P PDF
Editor: C. Lucchese, Authors: C. Lucchese, R. Perego, M. Kacimi, S. Orlando, F. Falchi
SAPIR (Search In Audio Visual Content Using Peer-to-Peer IR), D.4.3

State of the art of current P2P and ontology languages initiatives
Editor: A. Maurino, Authors: D. Beneventano, C. Aiello, … , F. Falchi, et al.
NeP4B (Networked Peers For Business), D2.1.1

Prototypes for building the semantic peer - First release
Editor: M. Vincini, Authors: L. Po, F. Guerra, T. Fagni, F. Flachi, M. Rosini, D. Cerizza, F. Corcoglioniti, M. Mordacchini
NeP4B (Networked Peers For Business), D3.2.1

Prototypes for building the semantic peer - Final release
Editor: M. Vincini, Authors: L. Po, F. Guerra, T. Fagni, F. Flachi, M. Rosini, D. Cerizza, F. Corcoglioniti, M. Mordacchini
NeP4B (Networked Peers For Business), D3.2.1



Technical Reports


Education

Master's degree in Computer Engineering
from the University of Pisa, Italy.

Ph.D. in Information Engineering
from Information Engineering Department of the University of Pisa, Italy.

Ph.D. in Informatics
from the Faculty of Informatics of the Masaryk University of Brno, Czech Republic.

MBA in “Innovation Management & Services Engineering”
from Scuola Superiore Sant'Anna, Pisa, Italy.

Piano Degree
under the guide of Prof.ssa Alma Cheli Quartaroli - Siena, 1995.

Music Composition “Compimento Inferiore”
under the guide of Prof. Andrea Nicoli at the Conservatory “G. Puccini” - La Spezia

Attended the “Third DELOS International Summer School on Digital Library Technologies” (ISDL 2004) and the “Scuola Nazionale dei Dottorati di Ricerca in Ingegneria Informatica” (National School of Information Engineering PhD Students).

Awards and Grants

Best Papers:

Grants:

Projects

Ongoing:

SmartNews (Social Sensing for Breaking News) aims at developing a tool able to support journalists in the whole process consisting of detecting breaking news, collecting relevant information about them and writing articles. The tool will "listen" to social media and will be able to automatically locate the breaking news.

Ended:

In the smart cities context, in the second half of 2013 CNR launched a project entitled Renewable Energy and ICT for Energy Sustainability (Energia da Fonti Rinnovabili e ICT per la Sostenibilità Energetica). The project was based on the widespread use of renewable energy sources (and related storage technologies and energy management) and the extensive use of ICT technologies for an enhanced management of the energy flows, thus making the energy services more efficient by adapting them to the demand (and, therefore, encouraging the energy saving and the energy rational use), with the informed involvement of citizens. One group of researchers in the CNR area of Pisa was involved in a part of this wide project. However, as already said, a smart Energy diffusion and management is only one aspect, among many others, of a smart city, and the CNR area in Pisa (the largest CNR area in Italy) is, in fact, a small city where smart technologies and applications can be experimented before to be reversed in a smart city.
Presto4U was a two-year project supported by a core network of 14 PrestoCentre members. The project aimed to identify useful results of research into digital audiovisual preservation and to raise awareness and improve the adoption of these both by technology and service providers as well as media owners. Fabrizio Falchi has been leader of the Research and Scientific Collections Community of Practice.
VISITO Tuscany (VIsual Support to Interactive TOurism in Tuscany) investigate and realize technologies able to offer an interactive and customized advanced tour guide service to visit the cities of art in Tuscany.
EAGLE, The Europeana network of Ancient Greek and Latin Epigraphy is a best-practice network co-funded by the European Commission, under its Information and Communication Technologies Policy Support Programme. EAGLE will provide a single user-friendly portal to the inscriptions of the Ancient World, a massive resource for both the curious and for the scholarly.
The European project SAPIR (Search on Audio-visual content using Peer-to-peer Information Retrieval ) developed a largescale, distributed Peer-to-Peer infrastructure that will make it possible to search for audio-visual content by querying the specific characteristics (i.e., features) of the content. SAPIR’s goal is to establish a giant Peer-to-Peer network, where users are peers that produce audiovisual content using multiple devices (e.g., cell phones) and service providers will use more powerful peers that maintain indexes and provide search capabilities
Advanced Service Search and Enhancing Technological Solutions for the European Digital Library is a 2 year project co-funded by the CIP Policy Support Programme which aims to improve the usability of Europeana by developing, implementing and deploying software services focused on search, browsing and interfaces. ASSETS strives also to make more digital items available on Europeana by involving content providers across different cultural environments.
MObility and Tourism in Urban Scenarios is a platform of services able to gather, aggregate and interpret in real time urban mobility data from different infrastructures scattered across urban areas and in historic cities. The main objective of the project is to improve the management, sustainability and environmental compatibility of urban mobility. Co-funded by Ministry of Economic Development in the framework of Industria 2015 Programme, MOTUS gives solutions to citizens and tourists needs in cities of artistic interest and tourist sites or in urban scenarios.
Networked Peers for Business, a scalable and flexible framework to provide advanced enterprise interoperation in a common business environment. This is based on a peer-to-peer (P2P) data-driven SWS network for B2B applications. Firms are free to join and leave the network at any time, to act both as a providers of their own services and consumers, and to classify their own profiles, offers, services and other features to gain public visibility to potential customers and partners.
Teaching & Talks

Teaching

Thesis Tutor

Talks

Fabrizio presented scientific results in the follolwing events:
Tools

Datasets

YFCC100M-HNfc6 is a deep features dataset extracted from the Yahoo Flickr Creative Commons 100M (YFCC100M) dataset created in 2014 as part of the Yahoo Webscope program. The dataset consists of approximately 99.2 million photos and 0.8 million videos, all uploaded to Flickr between 2004 and 2014 and published under a Creative Commons commercial or non commercial license.
3 million tweets (text and associated images) labeled according to the sentiment polarity of the text (positive, neutral and negative sentiment) predicted by a tandem LSTM-SVM architecture, obtaining a labeled set of tweets and images divided in 3 categories we called T4SA. We removed near-duplicate images and we selected a balanced subset of images, named B-T4SA, that we used to train our visual classifiers.
@InProceedings{Vadicamo_2017_ICCV_Workshops,
author = {Vadicamo, Lucia and Carrara, Fabio and Cimino, Andrea and Cresci, Stefano and Dell'Orletta, Felice and Falchi, Fabrizio and Tesconi, Maurizio},
title = {Cross-Media Learning for Image Sentiment Analysis in the Wild},
booktitle = {The IEEE International Conference on Computer Vision (ICCV)},
month = {Oct},
year = {2017}
} 
CNRPark
CNRPark is a benchmark of about 12,000 images of 250 parking spaces collected in different days, from 2 distinct cameras, which were placed to have different perspectives and angles of view, various light conditions and several occlusion patterns. We built a mask for each parking space in order to segment the original screenshots in several patches, one for each parking space. Each of these patches is a square of size proportional to the distance from the camera, the nearest are bigger then the farthest. We then labelled all the patches according to the occupancy status of the corresponding parking space.
@INPROCEEDINGS{7543901, 
author={G. Amato and F. Carrara and F. Falchi and C. Gennaro and C. Vairo}, 
booktitle={2016 IEEE Symposium on Computers and Communication (ISCC)}, 
title={Car parking occupancy detection using smart camera networks and Deep Learning}, 
year={2016}, 
pages={1212-1217}, 
doi={10.1109/ISCC.2016.7543901}, 
isbn      = {978-1-5090-0679-3},
publisher = {{IEEE} Computer Society}
}
CNRPark-Ext
CNRPark-Ext is a dataset of roughly 150,000 labeled images of vacant and occupied parking spaces, built on a parking lot of 164 parking spaces. CNRPark-EXT includes and significantly extends CNRPark.
		
@article{AMATO2017327,
title = "Deep learning for decentralized parking lot occupancy detection",
journal = "Expert Systems with Applications",
volume = "72",
number = "",
pages = "327 - 334",
year = "2017",
note = "",
issn = "0957-4174",
doi = "http://dx.doi.org/10.1016/j.eswa.2016.10.055",
url = "http://www.sciencedirect.com/science/article/pii/S095741741630598X",
author = "Giuseppe Amato and Fabio Carrara and Fabrizio Falchi and Claudio Gennaro and Carlo Meghini and Claudio Vairo",
keywords = "Machine learning",
keywords = "Classification",
keywords = "Deep learning",
keywords = "Convolutional neural networks",
keywords = "Parking space dataset"
}
A collection of 100 million images, with the corresponding descriptive features, to be used in experimenting new scalable techniques for similarity searching, and comparing their results. In the context of the SAPIR (Search on Audio-visual content using Peer-to-peer Information Retrieval) European project, we had to experiment our distributed similarity searching technology on a realistic data set. Therefore, since no large-scale collection was available for research purposes, we had to tackle the non-trivial process of image crawling and descriptive feature extraction (we used five MPEG-7 features) using the European EGEE computer GRID.
@article{DBLP:journals/corr/abs-0905-4627,
  author    = {Paolo Bolettieri and
               Andrea Esuli and
               Fabrizio Falchi and
               Claudio Lucchese and
               Raffaele Perego and
               Tommaso Piccioli and
               Fausto Rabitti},
  title     = {CoPhIR: a Test Collection for Content-Based Image Retrieval},
  journal   = {CoRR},
  volume    = {abs/0905.4627},
  year      = {2009},
  url       = {http://arxiv.org/abs/0905.4627},
  timestamp = {Wed, 07 Jun 2017 14:40:13 +0200},
  biburl    = {http://dblp.uni-trier.de/rec/bib/journals/corr/abs-0905-4627},
  bibsource = {dblp computer science bibliography, http://dblp.org}
}
Pisa Dataset

Code

VIR
VIR (Visual Information Retrieval) is a library for content based image retrieval and classification based on global and local features. The library allows comparing images considering their global and/or local features. It includes local features matching, RANSAC, MPEG-7 global features comparisons, kNN classification, Bag-of-Words (or Bag-of-Features) approach. It is an ongoing project.
Services

Sponsorship co-chair of SIGIR 2016, 39th International ACM SIGIR Conference on RR&D in Information Retrieval

Publications chair of the 8th International Conference on Similarity Search and Applications (SISAP 2015)

Chair of the track Engineering Large-Scale Distributed Systems (ELSDS) at SAC 2008, the 23rd Annual ACM Symposium on Applied Computing (Vila Galé in Fortaleza, Ceará, Brazil - March 16 - 20, 2008).

Chair of the CHORUS First workshop on peer to peer architectures for multimedia retrieval (1P2P4mm), co-located with INFOSCALE 2008.

Publicity Chair of INFOSCALE 2008, the Third International Conference on Scalable Information Systems.

Program Committee Member of:

Has served as reviewer for the following journals:

Contact Me

Pisa, Italy

+39 050 315 2911


Powered by w3.css