The Fifth Elephant 2019

Gathering of 1000+ practitioners from the data ecosystem


Siamese Triple Ranking Convolution Network in Signature Forgery Detection

Submitted by Souradip Chakraborty (@souradip) on Thursday, 13 June 2019

Preview video

Session type: Full talk of 40 mins


Identifying a credible signature match based on a base signature of a person is an age old problem. Despite recent automation and advances in this field using image recognition, a lot remains to be explored. We have developed an intelligent framework which can automatically detect a forged signature even if it is highly skilled, based on the developed feature embeddings and the corresponding algorithm. Siamese Triplet Convolution Neural Network is used to generate the feature embeddings for the signature images followed by a generalized Logistic Regression model to detect forgery. On the widely used SigComp dataset, our system achieves an accuracy of 96% in detecting forged signatures. Once the model is trained, it requires just one base image to determine whether another signature image is genuine or fraudulent with one shot learning. This algorithmic framework can be used in multiple commercial settings. One such example is testing customer or employee signatures on documents against a corresponding base signature saved beforehand.


The differences between the images of a genuine signature and its skilled forgery is at times very minute and is challenging to detect by even a trained eye. Deep Triplet loss function is a very powerful loss function used in the industry for face recognition. We have created our custom triplet model architecture with modified MobileNet CNN and dense layers with triplet loss function. Based on this loss, the image embeddings are created in such a way that the dissimilarity between the anchor image and positive image must be low and the dissimilarity between the anchor image and the negative image must be high for every triplet. This kind of architecture ensures that even small differences in signatures can be captured in order to flag a skilled forgery effectively.

The talk will cover the following:
• Introduction to the business objective of Signature Fraud Detection and the algorithmic challenges associated with Signature Fraud.
• A detailed domain background on various types of Forgery and their complexities.
• Description of the various Dataset sources and the complexities in data collection and forming the training set with image triplets.
• Introduction to Siamese Triplet CNN Architecture and one-shot learning applications in fraud detection.
• Transfer Learning and finetuning the siamese triplet model using MobileNet architecture and its benefits.
• Logistic loss function implementation with the above architecture to form a robust method in detecting fraud signature.
• Final Framework architecture of the entire methodology and the accuracy attained using the same.
• Reference and Conclusion.


Deep Learning,Computer Vision,Machine Learning, Image Processing.

Speaker bio

Ojaswini Chhabra received M.S. (Quantitative Economics) from Indian Statistical Institute, Delhi and B.A. (Hons.) Economics from University of Delhi in 2016 and 2014 respectively. She currently works as Senior Statistical Analyst in Walmart Labs, Bangalore. She has worked on several classification and optimization-based problems and filed patents for the same. Her research interests include natural language processing and computer vision.
Address: G-504, Tower 6, Adarsh Palm Retreat, Bellandur, Bengalore - 560103 Contact: +91-8285671581

Souradip Chakraborty received M.S. (Quality Management Science) from Indian Statis- tical Institute, Bangalore and B.E. (Engg.) Electronics and Instrumentation from Jadavpur University in 2016 and 2014 respectively. He is currently working as a Statistical Analyst in Walmart Labs, Bangalore. His current field of research interest lies in representation learning, mixed-space representations, NLP, Vision, and he has several patents filed (as a part of Walmart Labs) in the field of AI and Machine Learning applications.
Address: 603, Vasudeva Residency, 4th Cross Rd, Bansawadi, Bangalore - 560043 Contact: +91-9038790361


Preview video


  • Abhishek Balaji (@booleanbalaji) Reviewer 5 months ago

    Hi Ojaswini/Souradip,

    Thank you for submitting a proposal. As per the policy of The Fifth Elephant, we only allow one speaker on stage per session. Please decide among yourselves who’d be presenting and update the bio for the same. We’d be communicating only with the proposer. Further, we need to see more updated slides for your talk. Your slides must cover the following:

    • Problem statement/context, which the audience can relate to and understand. The problem statement has to be a problem (based on this context) that can be generalized for all.
    • What were the tools/frameworks available in the market to solve this problem? How did you evaluate these, and what metrics did you use for the evaluation? Why did you pick the option that you did?
    • Explain how the situation was before the solution you picked/built and how it changed after implementing the solution you picked and built? Show before-after scenario comparisons & metrics.
    • What compromises/trade-offs did you have to make in this process?
    • What is the one takeaway that you want participants to go back with at the end of this talk? What is it that participants should learn/be cautious about when solving similar problems?

    We need your updated slides by Jun 27, 2019 to evaluate your proposal. If we do not receive an update, we’d be moving your proposal for evaluation under a future event.

    • Abhishek Balaji (@booleanbalaji) Reviewer 4 months ago

      Marked as rejected since proposer hasnt responded to comments/updated content before deadline. Will be considered for a future event if content is updated.

Login with Twitter or Google to leave a comment