IMPLICATIONS OF AI GROK-BASED NCII PRODUCTION ON FEMALE BRAWIJAYA UNIVERSITY STUDENTS’ PERSONAL SECURITY ON SOCIAL MEDIA

Azahra Aulia Ramadani; Asih Purwanti

doi:10.59818/jps.v5i3.3293

IMPLICATIONS OF AI GROK-BASED NCII PRODUCTION ON FEMALE BRAWIJAYA UNIVERSITY STUDENTS’ PERSONAL SECURITY ON SOCIAL MEDIA

Azahra Aulia Ramadani - Brawijaya University
Asih Purwanti - Brawijaya University

Abstract

Generative AI such as Grok has accelerated the production of Non-Consensual Intimate Images (NCII) on platform X, a form of gender-based sexual violence threatening women's personal security, yet its effects on victims' subjective sense of safety remain underexamined. This study examines how AI Grok-based NCII production affects the personal security of female Brawijaya University students across five human-security dimensions: psychological security, freedom from fear, dignity, social participation, and protection-empowerment capacity. Using a qualitative descriptive design, data were gathered from 23 purposively sampled respondents via an open-ended online survey and literature review, analyzed thematically. Results show NCII is perceived as a threat extending beyond privacy, generating anxiety and anticipated insecurity even without direct victimization, reputational and dignity harm tied to gendered stigma, self-censorship restricting digital participation, and persistent distrust toward institutional protection despite some confidence in AI-based detection tools. It is concluded that AI-based NCII constitutes a multidimensional personal-security threat requiring accessible reporting, digital safety education, responsive moderation, and institutional support.

ABSTRAK

AI generatif seperti Grok telah mengakselerasi produksi Non-Consensual Intimate Images (NCII) di platform X, sebuah bentuk kekerasan seksual berbasis gender yang mengancam keamanan pribadi perempuan, namun dampaknya terhadap rasa aman subjektif korban masih belum banyak diteliti. Penelitian ini mengkaji bagaimana produksi NCII berbasis AI Grok memengaruhi keamanan pribadi mahasiswi Universitas Brawijaya melalui lima dimensi keamanan manusia: keamanan psikologis, kebebasan dari rasa takut, martabat, partisipasi sosial, serta kapasitas perlindungan dan pemberdayaan. Menggunakan desain deskriptif kualitatif, data dikumpulkan dari 23 responden yang dipilih secara purposive melalui survei daring terbuka dan kajian literatur, lalu dianalisis secara tematik. Hasil menunjukkan NCII dipersepsikan sebagai ancaman yang melampaui pelanggaran privasi, menimbulkan kecemasan dan ketidakamanan antisipatif meski tanpa viktimisasi langsung, kerugian reputasi dan martabat yang terkait stigma gender, swasensor yang membatasi partisipasi digital, serta ketidakpercayaan yang menetap terhadap perlindungan institusional meski ada sedikit keyakinan pada alat deteksi berbasis AI. Disimpulkan bahwa NCII berbasis AI merupakan ancaman multidimensional terhadap keamanan pribadi yang memerlukan mekanisme pelaporan yang mudah diakses, edukasi keamanan digital, moderasi yang responsif, dan dukungan institusional.

Keywords

artificial intelligence, human security, personal security, image-based sexual abuse, non-consensual intimate images ; kecerdasan buatan, keamanan manusia, keamanan personal, kekerasan seksual berbasis gambar, NCII

Full Text:

PDF

References

Almeida, T. C., Cardoso, J., Caridade, S., Pires, A. R., Matos, A. F., Costa, M., & Cunha, O. (2026). Mental health on victims of non-consensual intimate image-sharing: A scoping review. Sexuality Research and Social Policy. (https://doi.org/10.1007/s13178-026-01312-x)

Andersen-Rodgers, D., & Crawford, K. F. (2023). Human security: Theory and action (2nd ed.). Rowman & Littlefield.

Arkin, R. M., Wichman, A. L., & Carroll, P. J. (2015). Introducing handbook of personal security. In Handbook of personal security (pp. 1–17). Psychology Press. (https://doi.org/10.4324/9781315713595)

Benítez-Hidalgo, V., Pastor-Moreno, G., Ruiz-Pérez, I., & Amaya-Santos, S. (2026). Technology-facilitated sexual violence against women and its health impact: A mixed-methods systematic review. BMC Public Health, 26, 543. (https://doi.org/10.1186/s12889-026-26260-4)

Champion, A. R., Oswald, F., Khera, D., & Pedersen, C. L. (2022). Examining the gendered impacts of technology-facilitated sexual violence: A mixed methods approach. Archives of Sexual Behavior, 51(3), 1607–1624. (https://doi.org/10.1007/s10508-021-02226-y)

Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed.). SAGE.

Gupta, D. N., & Gogoi, S. (2025). Cyberbullying and gender: An analysis of legal protections for women on social media. International Journal of Environmental Sciences, 11(19).

Hannes, K., Hendricks, L., Brgles, M., & Dierckx, C. (n.d.). The SAGE handbook of qualitative research design: Being creative with resources in qualitative research.

Hawkins, W., Russell, C., & Mittelstadt, B. (2025). Deepfakes on demand: The rise of accessible non-consensual deepfake image generators (arXiv:2505.03859). arXiv. (https://doi.org/10.48550/arXiv.2505.03859)

Henry, N., McGlynn, C., Flynn, A., Johnson, K., Powell, A., & Scott, A. J. (2020). Image-based sexual abuse: A study on the causes and consequences of non-consensual nude or sexual imagery. Routledge. (https://doi.org/10.4324/9781351135153)

Heriyanto, H. (2018). Thematic analysis sebagai metode menganalisa data untuk penelitian kualitatif. Anuva: Jurnal Kajian Budaya, Perpustakaan, dan Informasi, 2(3), 317–324. (https://doi.org/10.14710/anuva.2.3.317-324)

Huber, A. R., & Ward, Z. (n.d.). Non-consensual intimate image distribution: Nature, removal, and implications for the Online Safety Act. (https://doi.org/10.1177/14773708241255821)

Im, J., Schoenebeck, S., Iriarte, M., Grill, G., Wilkinson, D., Batool, A., Alharbi, R., Funwie, A., Gankhuu, T., Gilbert, E., & Naseem, M. (2022). Women’s perspectives on harm and justice after online harassment. Proceedings of the ACM on Human-Computer Interaction, 6(CSCW2), 1–23. (https://doi.org/10.1145/3555775)

Kasita, I. D. (2022). Deepfake pornografi: Tren kekerasan gender berbasis online (KGBO) di era pandemi Covid-19. Jurnal Wanita dan Keluarga, 3(1), 16–26.(https://doi.org/10.22146/jwk.5202)

Kvale, S., & Brinkmann, S. (2009). InterViews: Learning the craft of qualitative research interviewing (2nd ed.). SAGE Publications.

Lakshané, R. (2024). Non-consensual intimate imagery: An overview (SSRN Scholarly Paper No. 4809632). Social Science Research Network. (https://papers.ssrn.com/abstract=4809632)

Lee, J.-Y. (2026). Silenced by non-consensual deepfakes: Perceived threat and online self-censorship among female users: Mediating roles of perceived control, belief in a just world, and passive SNS use.

Maras, M.-H., & Logie, K. (2024). Countering the complex, multifaceted nature of nude and sexually explicit deepfakes: An Augean task? Crime Science, 13(1), 31. (https://doi.org/10.1186/s40163-024-00226-6)

McGlynn, C., Rackley, E., & Houghton, R. (2017). Beyond ‘revenge porn’: The continuum of image-based sexual abuse. Feminist Legal Studies, 25(1), 25–46. (https://doi.org/10.1007/s10691-017-9343-2)

Miles, M. B., Huberman, A. M., & Saldaña, J. (2014). Qualitative data analysis: A methods sourcebook (3rd ed.). SAGE.

Nowell, L. S., Norris, J. M., White, D. E., & Moules, N. J. (2017). Thematic analysis: Striving to meet the trustworthiness criteria. International Journal of Qualitative Methods, 16(1), 1609406917733847. (https://doi.org/10.1177/1609406917733847)

Patton, M. Q. (2014). Qualitative research & evaluation methods: Integrating theory and practice. SAGE Publications.

SpaceXAI — Creators of Grok, the AI Chatbot. (n.d.). SpaceXAI.

Third hemispheric report on the implementation of the Belém do Pará Convention: Prevention of violence against women in the Americas: Paths to follow. (2017). Organization of American States.

Umbach, R., Henry, N., Shelby, R., Stevens, G., & Gonzalez-Pons, K. (2025). AI-generated image-based sexual abuse: Perpetration and consumption across three regions (SSRN Scholarly Paper No. 5958708). Social Science Research Network. (https://doi.org/10.2139/ssrn.5958708)

United Nations (with UNDP). (1994). Human development report 1994. Oxford University Press.

Viola, M., & Voto, C. (2023). Designed to abuse? Deepfakes and the non-consensual diffusion of intimate images. Synthese, 201(1), 30. (https://doi.org/10.1007/s11229-022-04012-2)

DOI: https://doi.org/10.59818/jps.v5i3.3293

BibTex Citation Data :

@article{JPS3293,
    	author = {Azahra Aulia Ramadani and Asih Purwanti},
    	title = {IMPLICATIONS OF AI GROK-BASED NCII PRODUCTION ON FEMALE BRAWIJAYA UNIVERSITY STUDENTS’ PERSONAL SECURITY ON SOCIAL MEDIA},
    	journal = {Public Sphere: Jurnal Sosial Politik, Pemerintahan dan Hukum},
    	volume = {5},
    	number = {3},
    	year = {2026},
    	keywords = {artificial intelligence, human security, personal security, image-based sexual abuse, non-consensual intimate images ; kecerdasan buatan, keamanan manusia, keamanan personal, kekerasan seksual berbasis gambar, NCII},
    	abstract = {Generative AI such as Grok has accelerated the production of Non-Consensual Intimate Images (NCII) on platform X, a form of gender-based sexual violence threatening women's personal security, yet its effects on victims' subjective sense of safety remain underexamined. This study examines how AI Grok-based NCII production affects the personal security of female Brawijaya University students across five human-security dimensions: psychological security, freedom from fear, dignity, social participation, and protection-empowerment capacity. Using a qualitative descriptive design, data were gathered from 23 purposively sampled respondents via an open-ended online survey and literature review, analyzed thematically. Results show NCII is perceived as a threat extending beyond privacy, generating anxiety and anticipated insecurity even without direct victimization, reputational and dignity harm tied to gendered stigma, self-censorship restricting digital participation, and persistent distrust toward institutional protection despite some confidence in AI-based detection tools. It is concluded that AI-based NCII constitutes a multidimensional personal-security threat requiring accessible reporting, digital safety education, responsive moderation, and institutional support. ABSTRAKAI generatif seperti Grok telah mengakselerasi produksi Non-Consensual Intimate Images (NCII) di platform X, sebuah bentuk kekerasan seksual berbasis gender yang mengancam keamanan pribadi perempuan, namun dampaknya terhadap rasa aman subjektif korban masih belum banyak diteliti. Penelitian ini mengkaji bagaimana produksi NCII berbasis AI Grok memengaruhi keamanan pribadi mahasiswi Universitas Brawijaya melalui lima dimensi keamanan manusia: keamanan psikologis, kebebasan dari rasa takut, martabat, partisipasi sosial, serta kapasitas perlindungan dan pemberdayaan. Menggunakan desain deskriptif kualitatif, data dikumpulkan dari 23 responden yang dipilih secara purposive melalui survei daring terbuka dan kajian literatur, lalu dianalisis secara tematik. Hasil menunjukkan NCII dipersepsikan sebagai ancaman yang melampaui pelanggaran privasi, menimbulkan kecemasan dan ketidakamanan antisipatif meski tanpa viktimisasi langsung, kerugian reputasi dan martabat yang terkait stigma gender, swasensor yang membatasi partisipasi digital, serta ketidakpercayaan yang menetap terhadap perlindungan institusional meski ada sedikit keyakinan pada alat deteksi berbasis AI. Disimpulkan bahwa NCII berbasis AI merupakan ancaman multidimensional terhadap keamanan pribadi yang memerlukan mekanisme pelaporan yang mudah diakses, edukasi keamanan digital, moderasi yang responsif, dan dukungan institusional.},
        	issn = {2964-5166},        	doi = {10.59818/jps.v5i3.3293},
        	url = {https://jurnal.penerbitwidina.com/index.php/JPS/article/view/3293}
    }