Privacy practices in the Indian technology ecosystem

Privacy practices in the Indian technology ecosystem

A 2020 survey of the makers of products and services

2020 might have been heralding the decade of privacy. From leaks in video conferencing software to doubts over COVID-19 apps, privacy concerns have been front and centre. While most of the commentary is when things go wrong, there is an angle not talked about: the attitudes of the people and organizations who make the technology we use on a daily basis. Their work today shapes our experience of tomorrow, but we know little of their perspective.

Between April and December 2020, the Privacy Mode team at Hasgeek (henceforth “we” and “us”) surveyed the makers of tech products and services in India. We sought to understand whether privacy is a guiding factor in product development, or an afterthought in response to regulation and public sentiment.

Summary of findings

We started by conducting interviews with experts, followed by focus group discussions. The learnings from these sessions helped frame hypotheses and a qualitative questionnaire. See our note on framing and review, and the detailed findings and analysis.

The survey finds that 90% of the respondents believe that their organization treats privacy as a fundamental right and that it attempts to realize that intent while building products and services. At the baseline, at least three in four respondents in authority roles require thinking about privacy and compliance issues across all organization sizes.

However converting that intent into practice remains an onerous challenge. Small and medium-sized organizations fare worse than large organizations. All three struggle with:

  1. Not having dedicated roles to manage conflicts arising out of product and engineering decisions on user privacy,
  2. Not having institutionalized “playbooks” (meaning process workflows, standard operating procedures and cultural values that shape consistent outcomes), and
  3. Peer groups to debate these issues both within and outside the organization.

Some industry sectors are governed by regulatory regimes such as HIPAA, CCPA and GDPR. The responses within these sectors did not deviate greatly from the general responses. This suggests adding regulatory pressure on small and medium organizations does not automatically change their internal product development dynamics to make them more privacy-friendly.

Over a fifth of respondents across all organization sizes say there is a lack of a peer group across the tech ecosystem to discuss and find solutions to privacy concerns. This lack was felt both within the organization and outside of it. This points to a larger concern where even those who may want to implement privacy-respecting features in products or services do not have the adequate support or use-cases to guide them. As organizations get larger, their access to external peer groups reduces, indicating the development of an insular culture.

  1. Close to 30% of organizations lack learning and development budgets for understanding privacy during product development.
  2. Small organizations find it particularly hard to get stakeholders interested in privacy concerns.
  3. Small and medium organizations do not have the organization structure or capability to have specialised departments to handle risk and compliance, which – combined with their lack of training budgets for privacy, and lack of standard procedures to handle privacy concerns or risk – is a point of great concern and will have implications across the tech ecosystem.

As one startup founder we interviewed said:

“Companies are doing a poor job communicating this (the need for user privacy and security)... I don’t think they are malicious. They’re lousy in their implementation and security, but there is no mal-intent or ill intent to begin with, they are lousy sometimes.”

Recommendations

The good news is that awareness about privacy and recognition of its importance as a practice – and as an end-user benefit – exists across leadership in large, medium and small organizations. The not-so-good news is that intent by itself is not sufficient to move organizations towards the ideal of protecting user privacy and user data.

As the data in this research shows, specialized personnel, budgets, processes and community resources have to be available in abundance if India wants a smooth transition towards a data protection regime. This is where the gap is.

Here are our recommendations for different stakeholders to move towards the privacy-preserving ideal, one step at a time.

  1. Small and medium organizations struggle to establish a business model with repeatable unit economics. This is a paramount concern in the early stages. While there is intent to embed privacy practices in the product-development cycle, small and medium organizations do not have the skills or budgets.

    As our data indicates, adding regulatory pressure does not improve outcomes. On the other hand, regulation can increase the compliance burden, thereby adversely affecting small and medium organizations and turning them into non-viable businesses.

    This research recommends to the Joint Parliamentary Committee (JPC) and the Data Protection Authority (DPA) for the Personal Data Protection (PDP) bill that the bill’s provisions must provide for exemptions for organizations below a certain revenue or fundraise threshold, and that the government must invest in the development of community resources to make the law feasible.

  2. Across all the segments, including large organizations, software engineering practices have not matured enough to be ready for PDP compliance from day one. There is also a lack of clarity at the operational level on the implementation of privacy processes such as consent management, data-security audits, data-erasure requests, anonymisation, and purpose limitation.

    Technical standards have to evolve – both from within and by knowledge-sharing at the community level – to address these issues. The JPC and DPA must provide at least two years’ time for organizations to become compliant with the standards prescribed in the PDP bill’s provisions.

  3. Business organizations, especially early and growth stage startups, generally refrain from sharing internal knowledge and practices with other organizations. Insecurity about growth and organizational secrets, and pressure from investors to grow Intellectual Property (IP), has led to a culture of withholding knowledge, making it hard to develop capacity.

    The structural capacity issues that this research refers to – skill gaps and lack of knowledge resources – can be resolved if leadership, legal, and data privacy officers in small and medium organizations become forthcoming about systematic best-practice and knowledge sharing. Journeyman documentation, which lays out the map of these practices at operational, and technical levels, will be more beneficial than broad directions.

    While simplistic solutions may get widespread adoption because they substitute for missing capacity, they will hamper small and medium organizations from competing on a global scale, mainly because these organizations may have to maintain and invent different sets of practices to comply with standards such as GDPR and CCPA. This will increase the cost of compliance.

  4. For investors, advisors and external stakeholders, as well as community organizations and founders of small and medium organizations, this research makes clear recommendations:

    1. Build capacity by contributing to a shared knowledge pool beyond your organization, in the form of meetup groups and their knowledge archives

    2. Encourage thinking about privacy at the product and engineering levels. Allow your practitioners to gain public recognition for their work.

    3. Take privacy preserving ideas and practices in product development cycles to external forums, to policy makers and such, and encourage adoption across the ecosystem.

Scroll down for the individual chapters.

About the principal researchers

Nadika Nadja is a researcher at Hasgeek. She has worked across advertising, journalism, TV & film production as a writer, editor and researcher.

Anand Venkatnarayanan has worked as a cybersecurity engineer for two decades. He is currently consulting editor for Privacy Mode and a non-executive director at Hasgeek.

Support team

Anish TP illustrated the report. Umesh PN, Zainab Bawa and Kiran Jonnalagadda edited. David Timethy was the project manager.

Acknowledgements

We would like to thank the following individuals from tech, legal, and policy backgrounds who provided feedback during different stages of the research. Their feedback helped the team fine-tune and bring rigour to the research process. While Hasgeek sought funding from organizations, the research itself was conducted – with full disclosure at all stages – independently and objectively, and the findings do not reflect any individual organization’s needs.

  1. Akshat Jain, Consultant at Omidyar Network India
  2. Alok Prasanna Kumar, Co-founder and senior resident fellow at Vidhi Centre for Legal Policy
  3. Ashwin Kumar, Director at FMR India
  4. Chinmayi S K, Founder at The Bachchao Project
  5. Raahil Rai, Investment Associate | Digital Society at Omidyar Network India
  6. Subhashish Bhadra, Principal at Omidyar Network India
  7. Suchana Seth, Founder and CEO at The Mindful AI Lab

Errata

Updates and corrections are posted in the Updates section. Use the “Follow” button to get notified.

Hosted by

Deep dives into privacy and security, and understanding needs of the Indian tech ecosystem through guides, research, collaboration, events and conferences. Sponsors: Privacy Mode’s programmes are sponsored by: more

Supported by

Omidyar Network India invests in bold entrepreneurs who help create a meaningful life for every Indian, especially the hundreds of millions of Indians in low-income and lower-middle-income populations, ranging from the poorest among us to the existing middle class. To drive empowerment and social i… more
Anand Venkatanarayanan

Anand Venkatanarayanan

@anandvenkatanarayanan

Nadika N

Nadika N

@nadikanadja

Kiran Jonnalagadda

Kiran Jonnalagadda

@jace Editor

Respondent organizations and designations

Submitted Apr 18, 2021

182 respondents completed the survey. They were asked for their organization and designation as optional plain text fields.

Designations were normalized to group equivalent roles and are represented in this word cloud:

Word cloud of designations

These normalized designations were further classified by whether they represent positions of authority:

  • Authority: Senior Manager, Product Manager, Founder, Director, CEO, Co-founder, Founder, CTO, and similar
  • Authority: Data Scientist, Senior Data Scientist, Product Designer and similar
  • Not authority: All other designations including Software Engineer, Developer and Consultant

The resulting split:

Authority Not authority
121 61

Organization names were normalized for typos and legal suffixes and to expand commonly used abbreviations, and were then categorized by size into small, medium and large:

  • Small: less than $10m in revenue or funding, or fewer than 100 employees
  • Medium: $10m–$100m in revenue or funding, or 100–500 employees
  • Large: more than $100m in revenue or funding, or more than 500 employees

Some organizations could not be identified from the public record. The resulting distribution:

Organization size Authority Not authority Total % Authority
Small 50 19 69 72.46%
Medium 33 8 41 80.48%
Large 32 25 57 56.14%
Unidentified 06 09 15 40.00%
Total 121 61 182 66.48%

167 of 182 respondents identified 137 distinct organizations. Some organizations had more than one respondent.

Organization size Respondents = 1 = 2 = 3 > 3
Small 69 63 6 0 0
Medium 41 32 6 2 1
Large 57 48 7 1 1
Total 167 143 19 3 2

Respondents were also asked to choose from a predefined list of technology domain areas they felt their organizations operated under:

Question 6: Technology domain area(s) of your organization (Multiple choice)

  1. Fin-Tech (Banking, Finance, Insurance, Lending, Insurance etc) (V1)
  2. Data Security (Infrastructure Security, Tools, Products etc.) (V2)
  3. Big Data (Large data processors, AI, ML) (V3)
  4. Services and Consultancy (for clients) (V4)
  5. Social networking/Media (V5)
  6. Mobile Application development/services (V6)
  7. Gaming and Entertainment (V7)
  8. Others (Descriptive answers) (V8)
Organization size V1 V2 V3 V4 V5 V6 V7 V8 Count
Small 11 15 12 32 13 18 04 29 69
Medium 10 08 16 18 04 07 02 14 41
Large 15 13 16 13 03 12 02 13 57
Unidentified 02 04 08 06 02 05 00 00 15
Total 38 40 52 69 22 42 08 56 182

From this, we infer:

  • The sample represents a broad base of views rather than that of a narrow segment.

  • The survey sample has a bias towards small and medium organizations (SMEs; 110/182 respondents), and towards authority roles (121/182).

  • These biases combine to create a stronger representation for authority roles in small and medium organizations (83/114), representing their views better than authority roles in large organizations.

Comments

{{ gettext('Login to leave a comment') }}

{{ gettext('Post a comment…') }}
{{ gettext('New comment') }}
{{ formTitle }}

{{ errorMsg }}

{{ gettext('No comments posted yet') }}

Hosted by

Deep dives into privacy and security, and understanding needs of the Indian tech ecosystem through guides, research, collaboration, events and conferences. Sponsors: Privacy Mode’s programmes are sponsored by: more

Supported by

Omidyar Network India invests in bold entrepreneurs who help create a meaningful life for every Indian, especially the hundreds of millions of Indians in low-income and lower-middle-income populations, ranging from the poorest among us to the existing middle class. To drive empowerment and social i… more