Please use this identifier to cite or link to this item:
http://hdl.handle.net/11667/284| Appears in Collections: | University of Stirling Research Data |
| Title: | BIBO |
| Other Titles: | Bias In, Bias Out: A Human-Validated Audit of Default-European Race-to-Role Assignment for High-Status Roles across Four Text-to-Image Models Who Holds the Gavel? Race, Mention Order, and Role Assignment in Two-Person Text-to-Image Generation |
| Creator(s): | Ali, Hazrat Jafri, Baqar |
| Contact Email: | ali.hazrat@stir.ac.uk |
| Keywords: | Computer Vision Generative AI Large Language Models Race Bias Representational Harm |
| Date Available: | 6-Nov-2026 |
| Citation: | Ali, H; Jafri, B (2026): BIBO [Bias In, Bias Out: A Human-Validated Audit of Default-European Race-to-Role Assignment for High-Status Roles across Four Text-to-Image Models]: Who Holds the Gavel? Race, Mention Order, and Role Assignment in Two-Person Text-to-Image Generation. University of Stirling. Dataset. https://doi.org/10.34722/sndm-kx77 |
| Publisher: | University of Stirling |
| Dataset Description (Abstract): | The BIBO dataset. This dataset provides the companion image corpus for the BIBO study. BIBO study stands for Bias In, Bias Out: A Human-Validated Audit of Default-European Race-to-Role Assignment for High-Status Roles across Four Text-to-Image Models, as detailed on https://hazratali.github.io/bibo/ and https://bibo.stir.ac.uk/. In summary, the main BIBO directory has 1,056 images organized into four sub folders, corresponding to the four audited models, namely, OpenAI GPT Image 1.5, Google Imagen 4, xAI Grok Imagine, and Stability AI SD 3.5 Large. TheBIBO role-swap follow-up folder has the images for the follow-up study. In the main BIBO study every prompt describes the high-status role first. The follow-up describes the low-status role first, with nothing else in the prompt changed, to test whether the European-presenting person is favoured for the high-status role or simply for being the person described first. In the Follow-up directory, there are a total of 314 images for the follow-up study, organized into two sub-folders, corresponding to two audited models, namely, OpenAI GPT Image 1.5 and xAI Grok Imagine. Disclaimer: These are AI-generated images of fictional people, not photographs of real people. The race labels are prompt and labeling categories, not claims about anyone's identity. The README file provides a detailed folder structure of the data directory. |
| Dataset Description (TOC): | BIBO image corpus — Directory structure This dataset provides the companion image corpus for the BIBO study. What is BIBO study? The BIBO study stands for Bias In, Bias Out: A Human-Validated Audit of Default-European Race-to-Role Assignment for High-Status Roles across Four Text-to-Image Models, as detailed on https://hazratali.github.io/bibo/ and https://bibo.stir.ac.uk/ In the main BIBO directory, there are the 1,056 images organized into four sub folders. Folders (one per audited model) inside the main BIBO directory - gpt-image-1.5/ OpenAI GPT Image 1.5 (264 images) - imagen-4.0-generate-001/ Google Imagen 4 (264 images) - grok-imagine-image/ xAI Grok Imagine (264 images) - sd3.5-large/ Stability AI SD 3.5 Large (264 images) Each model has 264 images = 24 images for baseline scenario + 240 images for two-race scenario. Total = 1,056. File naming D<scene>_<race-pair>_<order>_iter<NN>.png two-race image D<scene>_BASELINE_iter<NN>.png baseline image (no race named) <scene> = D01..D12 the 12 high-status scenes (see data/dyads.csv in the repo) <race-pair> = EU_AF (European vs African) or EU_EA (European vs East Asian) <order> = O1 (European named first) or O2 (European named second) <NN> = 01...05 five repetitions per two-race cell; 01...02 for baseline Example: D03_EU_AF_O1_iter02.png = scene 3, European vs African, European named first, repetition 2. Verify any image against the audited corpus Every image's SHA-256 hash is committed at SHA256SUMS.txt in the repository, keyed by outputs/images/<model>/<filename>. To check a file, compute its SHA-256 (sha256sum on Linux/macOS, Get-FileHash on Windows) and find the matching line. A match confirms the image is byte-identical to the one that was coded and analysed. BIBO role-swap follow-up (October 2026) In the main BIBO study every prompt describes the high-status role first. This follow-up describes the low-status role first, with nothing else in the prompt changed, to test whether the European-presenting person is favoured for the high-status role or simply for being the person described first. In the Follow-up directory, there are a total of 314 images for the follow-up study, organized into two sub-folders. Folders inside the BIBO role-swap follow-up directory - gpt-image-1.5/roles_swapped OpenAI GPT Image 1.5 (120 images) - gpt-image-1.5/original_order_same_session/ OpenAI GPT Image 1.5 (74 images) - grok-imagine-image/roles_swapped xAI Grok Imagine (120 images) Design for follow-up - Systems: GPT Image 1.5 and Grok Imagine. - Six scenes: doctor and patient, king and servant, CEO and receptionist, banker and customer, captain and sailor, coach and athlete (the six both systems rendered most reliably in the main study). - Both race pairs (European with African, European with East Asian), both race orders, 5 images per prompt: 120 images per system. - GPT Image 1.5 also regenerated the original prompts for the same scenes in the same session (74 images), as a check that the system had not changed since the main study. File names in the follow-up folder <prompt id>_iter<draw>.png, for example D01_EU_AF_O1_RS_iter03.png: D01 = scene 1; EU_AF = European and African; O1 = European named first (O2 = second); RS = roles swapped (absent for the original prompts); iter03 = third image of that prompt. Checking the files in the follow-up folder SHA256_manifest.csv lists every file with its SHA-256 hash, the prompt, the scene, the race pair, the order and the generation time. The same hashes are in the project's code repository, so this can help confirm that these are the images that were analysed. Disclaimer: These are AI-generated images of fictional people, not photographs of real people. The race labels are prompt and labeling categories, not claims about anyone's identity. How to populate Drop each model's images into its folder above, keeping the exact filenames. This layout mirrors outputs/images/<model>/ in the repository, so the committed hashes verify directly. |
| Type: | dataset image |
| Time Period: | 2026 |
| URI: | http://hdl.handle.net/11667/284 |
| Rights: | Rights covered by the standard CC-BY 4.0 licence: https://creativecommons.org/licenses/by/4.0/ |
| 3rd Party/Embedded Rights: | The dataset contains images generated by AI models as listed in the dataset description. |
| Affiliation(s) of Dataset Creator(s): | University of Stirling (Computing Science) University of Stirling (Marketing) |
Files in This Item:
| File | Description | Size | Format | |
|---|---|---|---|---|
| BIBO.zip | Note: very large file that may take a long time to download | 1.6 GB | ZIP | View/Open |
| README_BIBO_directory_structure.txt | 4.16 kB | Text | View/Open |
This item is protected by original copyright |
Items in DataSTORRE are protected by copyright, with all rights reserved, unless otherwise indicated.
