Tag Archive for: image description

The Art and Science of Describing Images Part Two (W)

Art and Science of Describing Images Part Two opening slideIn our series of free weekly webinars December 2nd saw a session focused on image description: part two in the series entitled, The Art and Science of Describing Images. This webinar focused on more complex images than Part One, with speakers Huw Alexander and Valerie Morrison digging deeper into how we approach alt text and long description.

This page contains:

Full Video of the Webinar

Speakers

  • Richard Orme, The DAISY Consortium—host and chair
  • Valerie Morrison—Center for Inclusive Design and Innovation at Georgia Institute of Technology
  • Huw Alexander—textBOX Digital

Session Overview

Huw Alexander opened this session giving us a brief resume of what the webinar will cover. The world has become driven by content especially in the digital space and, now more than ever, that content needs to be as accessible as possible. Over the last 10 years we have seen educational materials shift to a much more visual form of conveying information and society has followed suit. We need to be able to deliver this information so that it is accessible to everyone.

Valerie Morrison and Huw then took us through a series of complex image types, giving us an overview of how they tackle describing them and sharing with us their top tips for success. Valerie admitted that she still finds many types of images daunting, even with her years of experience but if you have the right approach you can break it down and keep it simple for the reader. Below are some of the main points for each image type which can be found in greater detail in the slide deck, together with some excellent examples.

Maps and Choropleths

Maps

  • Always begin with a general overview giving a description of what the map is about
  • If there’s an inset table this might be a good  place to start
  • Only describe items which are contextually important to the map
  • Lists are useful in describing maps
  • Don’t worry about colors (unless it’s a choropleth) or symbols which often don’t carry significance

Choropleths

These type of maps display quantitive values for distinct spatial regions using color. Consequently, they require a slightly different approach:

  • Reference the title, the structure, the text key which may point to colors to measure the data, the scale and the trend analysis
  • A political choropleth may also need dates, emphasis and context, places of interest, edge boundaries and a  scale ratio

Timelines

  • Create one general overview sentence
  • Describe the range of the timeline
  • List some of the details

Bar Charts

  • Begin with the title and what the x and y axis denote
  • Describe how the chart has been arranged and why. Sometimes bar charts are arranged to create a visual impact and this might require highlighting
  • Describe each bar in regular, predictable ways

Supply and Demand Curves

  • Begin again with the title and an x and y overview, remembering that this is just a graph!
  • Describe the slopes and where they intersect
  • Keep it simple. It’s easy to get lost in the “word salad” with this type of image

Complex Infographics

  • Overview sentence should contain information on the basic parts of the infographic, the timeline and the illustrations it contains
  • Work from the general to the specific, filling in the details as needed
  • Make sure your description references: the title, the structure of the graphic, the information contained within each section, descriptions of the relevant images only, numbered list elements
  • Do not describe decorative images

Tables

  • Sometimes the tables are arranged specifically for sighted readers and you should sort the information out into more of a table to help readers process the amount of data.
  • Complex STEM Infographics are very hard to parse and it’s much easier if you can convert them into tables with specific columns. An example of how making images available in multiple modalities can help reach more learners eg. a dyslexic reader would benefit from this specific approach.
  • Consider adding structural alt text to your tables. This gives the reader an head start in understanding how the table is organized and allows them to create a mental map before they process the information that it contains.

Before taking questions, Huw ended the session by reminding us:

You are trying to recreate the image and it’s impact for the reader. To do this you need to unravel the complexity it may involve and create a level playing field for all users.

Related Resources

Discover the other webinars we’re running!

Image Description: Advice From the Front Lines

a splattered ink blotter authoring equipment-notebook, sketch paper, post it notes, cell phone, paper clip, pen and pencilA few weeks ago The DAISY Consortium ran a webinar on image description and we were lucky to have some practical advice and top tips on hand from a variety of publishers. This blog piece looks at that advice and shows how different publishers are approaching the issue of image description which can be very different depending on the size and genre of publishing activity.

Image descriptions and how to handle them effectively were one of the greatest challenges identified by publishers in our seasonal accessibility survey. Do you ask your authors to contribute to the creation of image descriptions? Do you bake them into your internal workflows or do you choose to out-source them to a third party vendor who has an expertise in this area? All perfectly valid and reasonable solutions but how do you know what is the right path for your organization? There is no magic, one solution fits all answer to this but we will endeavour to shed some light on why the various options may or may not work for you.

Some Top Tips to Bear in Mind

A number of very useful tips were presented by Valerie Morrison from The Georgia Institute of Technology which will help to frame the advice from our contributing publishers. These have been listed next to the best practice advice from our publishers, where appropriate.

Kogan Page

Kogan Page is an independent publishing company founded in 1967 and headquartered in London, with branches in New York and New Delhi. Kogan Page specializes in business books and digital content, with over 1,000 titles published in key subject areas.

Current Practice

  • Image descriptions are outsourced to vendors rather than authors.
  • One vendor has team in-house
  • Another has a panel
  • Decided against author descriptions
  • Alt text and extended descriptions are provided

Advice

  • Develop guidelines for your vendors. Top Tip: Make sure you encourage your vendors to consider the “cognitive load” that is being presented to readers
  • Develop a small library of ‘exemplar figures/tables’
  • Control costs
  • Spot check vendor descriptions for QA

Macmillan Learning

Educational publisher, Macmillan Learning is one of the leading educational technology companies in North America. With a number of offices throughout the US, Macmillan Learning has been a driving force in accessible publishing, gaining awards and recognition for their innovative and inclusive approach.

Current Practice

Image descriptions are generated at Macmillan via a variety of different routes, depending on the nature of the content:

  • Originated by Authors
  • Outsourced as part of the ebook creation process
  • Description specialists with subject matter expertise may be the best choice for technical titles
  • In-house authoring where subject matter knowledge is available

Advice

  • Aim for iterative improvement rather than for perfection to begin with
  • Descriptions are content so you should remember to apply the same rules you use for anything else you publish
  • Be careful with the length of your descriptions – don’t err on the side of too much or too little. Top Tip: Try to keep to 125 characters or the length of a standard tweet

John Wiley & Sons

John Wiley & Sons is an American multinational publishing company founded in 1807 that focuses on academic publishing and instructional materials. The company produces books, journals, and encyclopedias, in print and electronically, as well as online products and services, training materials, and educational materials for undergraduate, graduate, and continuing education students.

Current Practice

  • All alt text is written by trained subject matter experts
  • Training includes understanding how descriptions are used with assistive technology
  • All alt text also goes through a QA process
  • Involve end users
  • Alt text creation begins during EPUB production
  • Care is taken when images are re-used

Advice

  • Become familiar with the different image concepts. Top Tip: Consider different modalities to convey meaning and to avoid overlap
  • Understand the difference between short and long descriptions, and when to apply them to an image. Top Tip: Some images don’t require lengthy descriptions. A photograph of a specific person might only need their name, a simple graphic might only need one sentence.
  • Create internal requirements around style and language to help create consistency in the learner’s experience
  • Alt text should not be used to teach, but to describe. Top Tip: Descriptions should be neutral and informative
  • Don’t forget spelling, punctuation, and grammar. Top Tip: don’t include any hard line breaks either and avoid acronyms and symbols (a screen reader will read everything)
  • And validate, validate, validate.

W.W. Norton

W. W. Norton & Company is an employee-owned publisher in the United States, which publishes fiction, nonfiction, poetry, college textbooks, cookbooks, art books, and professional books

Current Practice

  • The norm at W. W. Norton is to outsource to image description specialists, toward the end of the book’s production cycle
  • In-house editorial staff are responsible for reviewing all third-party image descriptions and are trained on this quite extensively.
  • Editorial assistants do sometimes author image descriptions in-house. Mainly when a non-STEM book revises and only a small number of images change
  • STEM or complex materials always require a specialist
  • Authors volunteer to describe images rarely. It’s preferable that they spend their time on content development

Advice

  • Aim for an equivalent experience to how people consume images visually. This is best accomplished by a short description and structured extended descriptions. Top Tip: Work from the general to the specific so that a sense of what is being described can be accessed immediately.
  • Write guidelines for yourself and other authors so that your chosen nomenclature is clear—whether you use “alt text,” “image description,” “short description,” etc.
  • There is no single solution for all images. Best practices and examples will help but authoring alt text ultimately requires quite a lot of executive functioning and decision making.

4 different publishers and 4 very different ways of approaching image description. What works for you? We’d love to hear about your experiences and any top tips that you can pass on to others. If we can share our various approaches then we can learn from each other and find a workflow that suits us. Drop us a line at office@inclusivepublishing.org

All 4 of our contributors support the development of in-house guidance to establish methods of working and house-style for a consistent approach to image description. These guidelines should be made available to 3rd party vendors or authors if that is the route you have chosen. An in-house quality check is necessary and during this time it is really important to keep in mind the needs of the reader and the context in which the specific images appear. Describing the meaning rather than the appearance will ensure you are considerate of the end users needs.

You may wish to register for our next webinar on image description entitled: The Art and Science of Image Description which takes a deeper dive with two more experts in this field.

Describing Images in Publications—Guidance, Best Practices and the Promise of Technology (W)

Describing Images Opening SlideIn our series of free weekly webinars June 17th saw a session focused onthe process of authoring quality image descriptions which are essential for accessibility.

This page contains:

Full Video of the Webinar

Speakers

  • Richard Orme, The DAISY Consortium—host and chair
  • Valerie Morrison—Georgia Institute of Technology
  • Charles La Pierre—Benetech
  • Gregorio Pellegrino—The LIA Foundation

Session Overview

Practical Tips and Advice for Writing Image Descriptions

Valerie Morrison gave us the benefit of her expertise to open this webinar giving our audience a list of best practice tips which can be applied to all image descriptions. These included:

  • summarize what you see to begin with in one general and informative sentence
  • keep your description neutral and informative
  • use proper grammar, spelling and punctuation. Avoid hard line breaks.
  • avoid acronyms and symbols (remember a screen reader will be reading everything you include)
  • Work from general to specific to provide a framework for the listener
  • Think about providing information in multiple modalities to vary the experience
  • Make sure that the surrounding text does not already describe the image. Avoid overlap

Knowing how long a description should be and when to stop is also important and Valerie recommends keeping to approx 125 characters. It can be hard to restrict the length of a description but screen reader software has limits. If an image is simply a photograph of a person, for example, it may be that the name of that person will suffice (depending on the context). Simple graphics can usually be described in one sentence and, whilst this can be challenging, this makes it easier for the listener—you don’t want to overload them.

Valerie’s slides give lots of examples of all of these useful notes with guidance given on describing symbols, charts and graphs.

Resources

Charles La Pierre presented the work of the DIAGRAM Center and the various resources that it offers the publishing industry. The POET tool is an image description training tool which focuses on:

  • When to describe images—is the information contained within the image essential to understanding?
  • How to describe images
  • Practice describing images

The Diagrammar resource is a framework for making images and graphics accessible. This data model provides a structured, standard way for image description data to be modeled.

Using AI to Automate Image Description

Gregorio Pellegrino presented the recent Italian project testing AI tools within the publishing industry with the goal of producing born accessible content. Results from this project revealed that:

  • some tools are better than others at identifying certain types of images
  • while the image category can be identified, more work is required before image descriptions are reliably produced

Depending on how images are classified, depends on which tool should be used and the next phase of this project will look to define an all-embracing taxonomy for image classification. This will enable the creation of datasets for training.

Publisher Approaches

Richard Orme presented comments and thoughts from 4 publishers who kindly agreed to participate in this webinar. See the slides for their full thoughts and comments

Kogan Page

Current Practice—descriptions are outsourced to vendors as it was decided not to proceed with author descriptions. These vendors provide alt text and extended descriptions.

Advice—Develop guidelines for your vendors with a small library of examples. Make sure you control costs and spot check descriptions when submitted by vendors.

Macmillan Learning

Current Practice—image descriptions are produced by a number of sources: the author, outsourced alongside ebook creation, description specialists or in-house

Advice—Descriptions are content so the same rules apply, be careful with the length of your descriptions

John Wiley & Sons

Current Practice—Alt text is written by subject matter experts which goes through a QA process. In-house training is provided to ensure understanding of descriptions are used with AT.

Advice—Become familiar with different image concepts, the various types of descriptions and when to apply them. Remember that alt text is there to describe, not teach.

W.W. Norton

Current Practice—image descriptions are outsourced to specialists towards the end of production. All descriptions are checked in-house for which there is extensive training provided

Related Resources

Discover the other webinars we’re running!

Free Webinar: Describing Images in Publications—Guidance, Best Practices and the Promise of Technology

June 17th, 2020

The DAISY Consortium has announced the launch of a series of free weekly webinars on accessible publishing and reading in response to the multiple challenges being faced by conferences around the world due to Coronavirus, as well as feedback from the wider DAISY community expressing interest in online training resources.

Authoring quality image descriptions are essential for accessibility. But the actual process of authoring an alternate description can be quite tricky, especially for complex content, graphically rich publications and vast back catalogues which need to be updated.

This webinar will:

  • discuss best practices for authoring image descriptions for publications.
  • hear from a range of publishers how they are tackling the challenge for new and backlist titles.
  • examine what AI and image recognition can currently offer and what the future might bring.

Date

June 17, 2020

Venue

Online via Zoom or via the DAISY YouTube channel afterwards

Learn More

Sign up for the June 17th webinar

For information on the whole DAISY webinar series on offer you can register your interest on the Webinar Information Page

Image Descriptions – The Who, What, Where and When (No Need for Why!)

Screenshot of the alt text and image description input screen on the inclusive publishing website

It’s official. Publishers are getting on with aceessibility. – they are realising that many of the “challenges” are not as daunting as they first thought and with the arrival of EPUB 3 and now the Ace by DAISY EPUB accessibility checking tool, there is every reason to look forward to increased access to mainstream ebooks in the future.

However, the one area that still comes up in conversation is image descriptions and how to tackle them for all kinds of books, be they simple texts with a few graphics, to complicated works that can be rich in complex material

This is a good dilemma to have. We no longer find ourselves having to advocate heavily for accessible publishing and rather we are now in the preferred position of helping publishers realise that they can do this – that it’s not as difficult as they might have first thought, for the most part.

Bill Kasdorf, in his recent article for Inclusive Publishing If Accessibility Is So Easy, Why Is It Still So Hard? identified image descriptions as the “top challenge” for publishers:

“You may think the issue is just that they need to do them. But there’s way more to it than that. They need to understand how to do them properly, and when not to do them.”

It’s so important for publishers to grasp the reason for image description and alt text, to get to grips with how to tackle them and how to relate them to the context in which they appear.  Does an image need a particular style of description based on the expected reading audience? You may need to provide an environmental description of a landscape or perhaps a geographical one….

A large pylon tower overlooking woodland

A geographical description of this image might be: The estuary scenery is a mix of salt marsh and tidal creeks flanked by industrial complexes.

Conversely, an environmental description would be quite differentThe large pylon lines tower over woodland and are visible for many miles around.

 

 

 

Creating successful image descriptions is truly a skill. Image description can vary greatly depending on the requirement of the given context.

Depending on the workflow employed, image descriptions and alt text can be added to a document at various different stages. We naturally advise all content providers to insert any accessibility features as early on as possible – build them in from the very start a bit like you would on a construction site. But this may not be entirely possible and we do appreciate that.

Your author is an obvious place to start as they are familiar with their own text in a way that no one else is. They should be able to provide the nuances and contextual information that some rich graphics require. However, they may not be aware of the accessibility requirements behind image description or indeed the technical requirements of this additional content. Some publishers are providing training for their authors so that they can write descriptions that are meaningful and relevant and in some cases the requirement for this is built into their contract in the first place.

This may not be practical for everyone and so it may fall to editorial or production staff in-house or even 3rd party vendors with an expertise in this area. The important thing is to formally build this stage in your production process into your workflow so that it just becomes a natural part of your ebook development cycle.

Great – so you understand you need to do this and you’ve worked out who is best placed within your organization to take responsibility for it but what exactly do they need to do?

Most importantly you need to identify what the images within your content require in terms of accessibility. Not all images require description or alt text – they may be purely decorative and if this is the case then you should make sure they are labelled as such. Screen readers and other  forms of assistive technology need to be able to let their readers know what an image’s purpose is and if something is purely decorative then there is nothing more to be done.

If your image carries meaning or relevant information then it is vital that you describe this to your reader. Alternative text provides screen reader software users with access to all of the non-text information.

“This is why context matters the most, as you want to think about what information is the most important, the more pertinent, that you are trying to get across with an image.” (Oregon State University)

“Don’t just repeat the image caption in the alt text—how annoying is that, to have it read to you twice by your screen reader? The image description shouldn’t just say what the image is, it should say what it is there for, what it is trying to convey within a given context. This can require two distinct types of expertise: subject matter expertise, and an understanding of what a user of assistive technology needs.” (Bill Kasdorf)

Some complex images require longer description. You may be publishing a table full of complex data and in this case a short description in the alt text is a good place to start and then a longer more in-depth analysis / description can be achieved in the long desc box.

You may be wondering if Artificial Intelligence could be the answer? On the surface, deploying next generation technologies like artificial intelligence to generate image descriptions makes a lot of sense. Facebook, Google and Microsoft all have solutions in place to analyse an image and recommend an alternative text description of the image. It really is an interesting concept, and as the technology continues to evolve we should get more accurate descriptions of images. We will be covering this topic in more detail in a separate article but suffice to say it is still a way off from being a feasible solution.

Photo shows Captionbot.ai from Microsoft which has been shown a photo of a pair of glasses resting on an open book, which it believes is a “stack of flyers on a table”.

 

 

 

 

 

 

 

 

 

 

 

 

Photo shows Captionbot.ai from Microsoft which has been shown a photo of a pair of glasses resting on an open book, which it believes is a “stack of flyers on a table”.

The RNIB has recently published some top tips for image description in social media but we think they are just as relevant for ebooks:

  • Don’t overthink it! Make your description as short as possible while describing what the photo is trying to convey.
  • You generally don’t have to say “image of”. Screen readers already know that there’s an image and they announce this before reading the image description.
  • It’s ok to mention colour if it’s relevant to the image. Many screen reader users are partially sighted and use descriptions to clarify indistinct images (also people with sight loss do understand the concept of colour).
  • Helpful v unhelpful: It’s important that your description helps to convey the intended message of the image. For example, a tweet shared an upcoming weather forecast with the text: “It’s going to get better soon!” A helpful image description would be: “Forecast showing temperatures of -18 degrees Celsius today improving to -1 degrees by Tuesday”. An unhelpful description would be: “Picture of weather forecast”.
  • Trying to convey humour? Make sure this is also reflected in your image description so that all users can enjoy the joke. For example: “Dog looks suspiciously at the photo taker with the words: Where did the goat go?”

Most importantly – give it a go! Success comes with practice and publishers should bite the bullet and get on with it. It’s not that difficult!

A Few Resources to Help Get You Started:

The Accessible Books Consortium hosts a free 20 minute online training session on Accessible Images – describing what these are exactly and how best to tackle various types of images.  Very useful for beginners and handy for in-house awareness training.

The DIAGRAM Centre provides a host of resources designed to help content providers with image description. The POET tool “is an open-source web based image description training tool that helps people learn how to describe the various types of images found in digital books including complex images such as flow charts and Venn diagrams.”

Alongside this the DIAGRAM Centre also provides a set of comprehensive guidelines, samples and training. Work on these projects is on-going as a11y features and products advance.