{"id":3903,"date":"2022-07-18T16:40:05","date_gmt":"2022-07-18T16:40:05","guid":{"rendered":"https:\/\/billsbud.org\/?p=3903"},"modified":"2022-07-18T16:40:05","modified_gmt":"2022-07-18T16:40:05","slug":"reducing-bias-and-improving-safety-in-dall%c2%b7e-2","status":"publish","type":"post","link":"https:\/\/billsbud.org\/?p=3903","title":{"rendered":"Reducing Bias and Improving Safety in DALL\u00b7E 2"},"content":{"rendered":"<p><!--kg-card-begin: markdown--><img decoding=\"async\" src=\"https:\/\/openai.com\/content\/images\/2022\/07\/reducing-bias-and-improving-safety-in-dall-e-2-og.jpg\" alt=\"Reducing Bias and Improving Safety in DALL&#xB7;E 2\"><\/p>\n<p>Today, we are implementing a new technique so that DALL&#xB7;E generates images of people that more accurately reflect the diversity of the world&#x2019;s population. This technique is applied at the system level when DALL&#xB7;E is given a prompt describing a person that does not specify race or gender, like &#x201C;firefighter.&#x201D;<\/p>\n<p>Based on our internal evaluation, users were 12&#xD7; more likely to say that DALL&#xB7;E images included people of diverse backgrounds after the technique was applied. We plan to improve this technique over time as we gather more data and feedback.<\/p>\n<div class=\"wide\">\n<div class=\"mb-1\">\n<div class=\"toggle-wrapper d-flex flex-column\">\n<ul class=\"toggle-list list-unstyled d-flex mb-0\">\n<li class=\"medium-xsmall-copy\">\n          <button class=\"js-toggler py-0.25 mr-0.5 button-unstyled medium-xsmall-copy active\" aria-selected=\"false\" data-js-id=\"ceo\" data-js-prompt=\"A photo of a CEO\"><br \/>\n            CEO<br \/>\n          <\/button>\n        <\/li>\n<li class=\"medium-xsmall-copy\">\n          <button class=\"js-toggler py-0.25 mr-0.5 button-unstyled medium-xsmall-copy\" aria-selected=\"false\" data-js-id=\"woman\" data-js-prompt=\"A portrait of a woman\"><br \/>\n            Woman<br \/>\n          <\/button>\n        <\/li>\n<li class=\"medium-xsmall-copy\">\n          <button class=\"js-toggler py-0.25 mr-0.5 button-unstyled medium-xsmall-copy\" aria-selected=\"true\" data-js-id=\"firefighter\" data-js-prompt=\"A portrait of a heroic firefighter\"><br \/>\n            Firefighter<br \/>\n          <\/button>\n        <\/li>\n<li class=\"medium-xsmall-copy\">\n          <button class=\"js-toggler py-0.25 mr-0.5 button-unstyled medium-xsmall-copy\" aria-selected=\"false\" data-js-id=\"teacher\" data-js-prompt=\"A portrait of a teacher\"><br \/>\n            Teacher<br \/>\n          <\/button>\n        <\/li>\n<li class=\"medium-xsmall-copy\">\n          <button class=\"js-toggler py-0.25 button-unstyled medium-xsmall-copy\" aria-selected=\"false\" data-js-id=\"software-engineer\" data-js-prompt=\"A portrait of a software engineer\"><br \/>\n            Software Engineer<br \/>\n          <\/button>\n        <\/li>\n<\/ul><\/div>\n<hr class=\"ruler my-0\">\n  <\/div>\n<div class=\"prompt font-sans-serif mb-1\">\n    <span aria-label=\"Prompt used to generate results in DALL&#xB7;E 2\" class=\"js-prompt\">A photo of a CEO<\/span><\/p>\n<div aria-hidden=\"true\" class=\"prompt-button font-sans-serif\">Generate<\/div>\n<\/p><\/div>\n<div class=\"row js-gallery\">\n<div class=\"col-6\">\n<figure>\n<div class=\"image-grid\">\n<div>\n            <img data-src=\"https:\/\/cdn.openai.com\/dall-e-2-improving-bias-and-safety\/draft-20220717a\/ceo-original-1.jpg\" class=\"js-lazy js-image-result mb-0\" alt=\"Reducing Bias and Improving Safety in DALL&#xB7;E 2\">\n          <\/div>\n<div>\n            <img data-src=\"https:\/\/cdn.openai.com\/dall-e-2-improving-bias-and-safety\/draft-20220717a\/ceo-original-2.jpg\" class=\"js-lazy js-image-result mb-0\" alt=\"Reducing Bias and Improving Safety in DALL&#xB7;E 2\">\n          <\/div>\n<div>\n            <img data-src=\"https:\/\/cdn.openai.com\/dall-e-2-improving-bias-and-safety\/draft-20220717a\/ceo-original-3.jpg\" class=\"js-lazy js-image-result mb-0\" alt=\"Reducing Bias and Improving Safety in DALL&#xB7;E 2\">\n          <\/div>\n<div>\n            <img data-src=\"https:\/\/cdn.openai.com\/dall-e-2-improving-bias-and-safety\/draft-20220717a\/ceo-original-4.jpg\" class=\"js-lazy js-image-result mb-0\" alt=\"Reducing Bias and Improving Safety in DALL&#xB7;E 2\">\n          <\/div>\n<div>\n            <img data-src=\"https:\/\/cdn.openai.com\/dall-e-2-improving-bias-and-safety\/draft-20220717a\/ceo-original-5.jpg\" class=\"js-lazy js-image-result mb-0\" alt=\"Reducing Bias and Improving Safety in DALL&#xB7;E 2\">\n          <\/div>\n<div>\n            <img data-src=\"https:\/\/cdn.openai.com\/dall-e-2-improving-bias-and-safety\/draft-20220717a\/ceo-original-6.jpg\" class=\"js-lazy js-image-result mb-0\" alt=\"Reducing Bias and Improving Safety in DALL&#xB7;E 2\">\n          <\/div>\n<\/p><\/div><figcaption class=\"mt-0\">Before mitigation<\/figcaption><\/figure>\n<\/p><\/div>\n<div class=\"col-6\">\n<figure>\n<div class=\"image-grid\">\n<div>\n            <img data-src=\"https:\/\/cdn.openai.com\/dall-e-2-improving-bias-and-safety\/draft-20220717a\/ceo-treatment-1.jpg\" class=\"js-lazy js-image-result mb-0\" alt=\"Reducing Bias and Improving Safety in DALL&#xB7;E 2\">\n          <\/div>\n<div>\n            <img data-src=\"https:\/\/cdn.openai.com\/dall-e-2-improving-bias-and-safety\/draft-20220717a\/ceo-treatment-2.jpg\" class=\"js-lazy js-image-result mb-0\" alt=\"Reducing Bias and Improving Safety in DALL&#xB7;E 2\">\n          <\/div>\n<div>\n            <img data-src=\"https:\/\/cdn.openai.com\/dall-e-2-improving-bias-and-safety\/draft-20220717a\/ceo-treatment-3.jpg\" class=\"js-lazy js-image-result mb-0\" alt=\"Reducing Bias and Improving Safety in DALL&#xB7;E 2\">\n          <\/div>\n<div>\n            <img data-src=\"https:\/\/cdn.openai.com\/dall-e-2-improving-bias-and-safety\/draft-20220717a\/ceo-treatment-4.jpg\" class=\"js-lazy js-image-result mb-0\" alt=\"Reducing Bias and Improving Safety in DALL&#xB7;E 2\">\n          <\/div>\n<div>\n            <img data-src=\"https:\/\/cdn.openai.com\/dall-e-2-improving-bias-and-safety\/draft-20220717a\/ceo-treatment-5.jpg\" class=\"js-lazy js-image-result mb-0\" alt=\"Reducing Bias and Improving Safety in DALL&#xB7;E 2\">\n          <\/div>\n<div>\n            <img data-src=\"https:\/\/cdn.openai.com\/dall-e-2-improving-bias-and-safety\/draft-20220717a\/ceo-treatment-6.jpg\" class=\"js-lazy js-image-result mb-0\" alt=\"Reducing Bias and Improving Safety in DALL&#xB7;E 2\">\n          <\/div>\n<\/p><\/div><figcaption class=\"mt-0\">After mitigation<\/figcaption><\/figure>\n<\/p><\/div>\n<\/p><\/div>\n<\/div>\n<p>In April, we started previewing the DALL&#xB7;E 2 research to a limited number of people, which has allowed us to better understand the system&#x2019;s capabilities and limitations and improve our safety systems.<\/p>\n<p>During this preview phase, early users have flagged sensitive and biased images which have helped inform and evaluate this new mitigation.<\/p>\n<p>We are continuing to research how AI systems, like DALL&#xB7;E, might reflect biases in its training data and different ways we can address them.<\/p>\n<p>During the research preview we have taken other steps to improve our safety systems, including:<\/p>\n<ul>\n<li>Minimizing the risk of DALL&#xB7;E being misused to create deceptive content by rejecting image uploads containing realistic faces and attempts to create the likeness of public figures, including celebrities and prominent political figures.<\/li>\n<li>Making our content filters more accurate so that they are more effective at blocking prompts and image uploads that violate our <a href=\"https:\/\/labs.openai.com\/policies\/content-policy\">content policy<\/a> while still allowing creative expression.<\/li>\n<li>Refining automated and human monitoring systems to guard against misuse.<\/li>\n<\/ul>\n<p>These improvements have helped us gain confidence in the ability to invite more users to experience DALL&#xB7;E.<\/p>\n<p>Expanding access is an important part of our <a href=\"https:\/\/openai.com\/blog\/language-model-safety-and-misuse\/\">deploying AI systems responsibly<\/a> because it allows us to learn more about real-world use and continue to iterate on our safety systems.<\/p>\n<style>\n  .prompt {\n    border-radius: 6px;\n    padding: 13px 14px;\n    font-size: 15px;\n    line-height: 1em;\n    background-color: #fff;\n    box-shadow: 0 2px 4px 0 rgb(0 0 82 \/ 15%);\n    position: relative;\n  }<\/p>\n<p>  .prompt-button {\n    position: absolute;\n    right: 0;\n    top: 0;\n    height: 100%;\n    display: flex;\n    justify-content: center;\n    align-items: center;\n    border-left: 1px solid rgba(0,0,0,.05);\n    padding: 0 16px 0 14px;\n    font-size: 16px;\n    font-weight: 700;\n    color: #999999;\n  }<\/p>\n<p>  .image-grid {\n    display: grid;\n    gap: 4px 4px;\n    grid-template-rows: repeat(3, 1fr);\n    grid-template-columns: repeat(2, 1fr);\n  }<\/p>\n<p>  .loading .image-grid {\n    animation: pulsate 2000ms infinite;\n  }<\/p>\n<p>  @media (min-width: 768px) {\n    .image-grid {\n      grid-template-rows: repeat(2, 1fr);\n      grid-template-columns: repeat(3, 1fr);\n    }\n  }<\/p>\n<p>  .js-toggler {\n    opacity: 0.4;\n    border-bottom: 1px solid transparent;\n    outline: none !important;\n    cursor: pointer;\n    border-radius: 0;\n  }<\/p>\n<p>  .js-toggler.active {\n    border-bottom-color: currentColor;\n    opacity: 1;\n  }<\/p>\n<p>  @media (max-width: 767px) {\n    .toggle-wrapper {\n      margin-left: -3.333333%;\n      width: calc(100% + 6.666667%);\n      padding: 0 3.333333%;\n      scrollbar-width: 0;\n      overflow: auto;\n      -webkit-overflow-scrolling: touch;\n    }<\/p>\n<p>    .toggle-list {\n      min-width: max-content;\n    }<\/p>\n<p>    .toggle-wrapper::-webkit-scrollbar {\n      display: none;\n    }\n  }<\/p>\n<p>  .ruler {\n    position: relative;\n    top: -1px;\n  }<\/p>\n<p>  @keyframes pulsate {\n    50% { opacity: 0.75; }\n  }\n<\/style>\n<p><script type=\"module\">\n  var images = [...document.querySelectorAll('.js-image-result')];\n  var prompt = document.querySelector('.js-prompt');\n  var gallery = document.querySelector('.js-gallery');<\/p>\n<p>  var loadImages = async function(oldId, newId) {\n    return new Promise(function(resolve, reject) {\n      var newUrls = images.map(function(img) {\n        return img.src.replace(oldId, newId);\n      });\n      var remaining = newUrls.length;\n      var newImages = [];<\/p>\n<p>      for (var i = 0; i < newUrls.length; i++) {\n        var img = new Image();\n        img.onload = function() {\n            --remaining;\n            newImages.push(img);\n            if (remaining <= 0) {\n              resolve(newImages);\n            }\n        };\n        img.src = newUrls[i];\n      }\n    });\n  }\n\n  var handleToggler = async function(e) {\n    var target = e.currentTarget;\n    var oldActiveToggler = document.querySelector('.js-toggler.active');\n\n    \/\/ Update toggle active state\n    oldActiveToggler.classList.remove('active');\n    oldActiveToggler.setAttribute('aria-selected', 'false');\n    target.classList.add('active');\n    target.setAttribute('aria-selected', 'true');\n\n    \/\/ Update prompt input\n    prompt.innerText = target.dataset.jsPrompt;\n\n    \/\/ Enable loading animation\n    const animationTimeout = setTimeout(function() {\n      gallery.classList.add('loading');\n    }, 250);\n\n    \/\/ Load new images in the background\n    await loadImages(oldActiveToggler.dataset.jsId, target.dataset.jsId);\n\n    clearTimeout(animationTimeout);\n\n    \/\/ Remove loading animation and update images\n    images.forEach(function(image, index) {\n      image.setAttribute('src', image.src.replace(oldActiveToggler.dataset.jsId, target.dataset.jsId));\n    });\n\n    gallery.classList.remove('loading');\n  };\n\n  document.addEventListener('DOMContentLoaded', function() {\n    [...document.querySelectorAll('.js-toggler')].forEach(function(toggler) {\n      toggler.addEventListener('click', handleToggler);\n      toggler.addEventListener('mouseenter', function(e) {\n        var target = e.currentTarget;\n        var oldActiveToggler = document.querySelector('.js-toggler.active');\n\n        loadImages(oldActiveToggler.dataset.jsId, target.dataset.jsId);\n      });\n    });\n  });\n<\/script><!--kg-card-end: markdown--><\/p>\n<p>source <a href=\"https:\/\/openai.com\/blog\/reducing-bias-and-improving-safety-in-dall-e-2\/\">https:\/\/openai.com\/blog\/reducing-bias-and-improving-safety-in-dall-e-2\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Today, we are implementing a new technique so that DALL&#xB7;E generates images of people that more accurately reflect the diversity of the world&#x2019;s population. This technique is applied at the system level when DALL&#xB7;E is given a prompt describing a person that does not specify race or gender, like &#x201C;firefighter.&#x201D; Based on our internal evaluation, &hellip; <a href=\"https:\/\/billsbud.org\/?p=3903\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Reducing Bias and Improving Safety in DALL\u00b7E 2<\/span> <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","footnotes":""},"categories":[1],"tags":[],"class_list":["post-3903","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/billsbud.org\/index.php?rest_route=\/wp\/v2\/posts\/3903","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/billsbud.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/billsbud.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/billsbud.org\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/billsbud.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3903"}],"version-history":[{"count":1,"href":"https:\/\/billsbud.org\/index.php?rest_route=\/wp\/v2\/posts\/3903\/revisions"}],"predecessor-version":[{"id":3904,"href":"https:\/\/billsbud.org\/index.php?rest_route=\/wp\/v2\/posts\/3903\/revisions\/3904"}],"wp:attachment":[{"href":"https:\/\/billsbud.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3903"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/billsbud.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3903"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/billsbud.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3903"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}