On Tinder, artificial intelligence and deep learning help fight harassment

0
On Tinder, artificial intelligence and deep learning help fight harassment

Founded in 2012 on a university campus, the dating platform has become the most used app in the world in its field. It is now available in 190 countries and multiple languages and has been downloaded over 430 million times. To further protect its users, the Tinder platform has implemented new features that can be very helpful in combating inappropriate behavior.

New features to prevent and alert

Since its launch, Tinder teams have been regularly installing new features to improve the platform’s usability and implement effective ways to prevent its users, and especially its female users, from being victims of cyber-stalking. New tools have just been added to a long list of security and member protection tools.

The first feature added to the app is the DTBY (Does This Bother You?) tool, which provides concrete support to app members. When a slur or inappropriate comment is automatically detected during a conversation between two members, Tinder will offer users the opportunity to report it. The use of this feature is therefore possible thanks to machine learning and direct input from Tinder members, allowing the community to have more control. Since the implementation of this tool that allows to alert, 46% more reports have been recorded.

The second feature, which is a warning feature, is AYS (Are You sure?). This feature warns the sender when writing their message: it asks them to think about what they are saying before sending their message, as it could be offensive to the recipient. This feature uses artificial intelligence to detect offensive and malicious language. The tool was developed as a result of several messages reported as inappropriate by the Tinder community. Since its development, AYS has already reduced inappropriate language in sent messages by more than 10%.

However, users can still disregard these prevention messages and send their insults which will not be blocked. The recipient is instead prompted to click “DTBY?” if they feel attacked.

How to activate these features?

To activate DTBY and AYS, members only need to give their consent. This allows both features to access content and detect malicious and offensive messages. These new tools launched by Tinder better protect users and make them feel more confident.

In the event that a member does not wish to give consent, they will still be able to use the Swipe feature (users swipe right if they like a profile, or swipe left if they want to ignore it) but will no longer be able to send messages. It should be noted that these features also allow the application to take action against members who do not respect the community rules.

Support from the RAINN Association

The association RAINN – Rape, Abuse & Incest National Network – supported the development of these new features on the platform. RAINN is an American organization that fights against sexual violence and works to ensure that the perpetrators of sexual assault are punished by the law. The encouragement given by this association to Tinder is therefore welcome and reinforces the need to fight against harassment on the platform.

Tinder’s involvement in the fight against harassment is part of Match Group‘s Trust & Safety program. This program represents $100 million of investment in 2021 to combat inappropriate behavior. In addition, the platform is committed to working with experts to ensure the safety and inclusiveness of the app.

Translated from Sur Tinder, l’intelligence artificielle et le Deep Learning au service de la lutte contre le harcèlement