The Black Box Society

The Black Box Society

Author: Frank Pasquale

Publisher: Harvard University Press

Published: 2015-01-05

Total Pages: 320

ISBN-13: 0674967100

DOWNLOAD EBOOK

Every day, corporations are connecting the dots about our personal behavior—silently scrutinizing clues left behind by our work habits and Internet use. The data compiled and portraits created are incredibly detailed, to the point of being invasive. But who connects the dots about what firms are doing with this information? The Black Box Society argues that we all need to be able to do so—and to set limits on how big data affects our lives. Hidden algorithms can make (or ruin) reputations, decide the destiny of entrepreneurs, or even devastate an entire economy. Shrouded in secrecy and complexity, decisions at major Silicon Valley and Wall Street firms were long assumed to be neutral and technical. But leaks, whistleblowers, and legal disputes have shed new light on automated judgment. Self-serving and reckless behavior is surprisingly common, and easy to hide in code protected by legal and real secrecy. Even after billions of dollars of fines have been levied, underfunded regulators may have only scratched the surface of this troubling behavior. Frank Pasquale exposes how powerful interests abuse secrecy for profit and explains ways to rein them in. Demanding transparency is only the first step. An intelligible society would assure that key decisions of its most important firms are fair, nondiscriminatory, and open to criticism. Silicon Valley and Wall Street need to accept as much accountability as they impose on others.


Book Synopsis The Black Box Society by : Frank Pasquale

Download or read book The Black Box Society written by Frank Pasquale and published by Harvard University Press. This book was released on 2015-01-05 with total page 320 pages. Available in PDF, EPUB and Kindle. Book excerpt: Every day, corporations are connecting the dots about our personal behavior—silently scrutinizing clues left behind by our work habits and Internet use. The data compiled and portraits created are incredibly detailed, to the point of being invasive. But who connects the dots about what firms are doing with this information? The Black Box Society argues that we all need to be able to do so—and to set limits on how big data affects our lives. Hidden algorithms can make (or ruin) reputations, decide the destiny of entrepreneurs, or even devastate an entire economy. Shrouded in secrecy and complexity, decisions at major Silicon Valley and Wall Street firms were long assumed to be neutral and technical. But leaks, whistleblowers, and legal disputes have shed new light on automated judgment. Self-serving and reckless behavior is surprisingly common, and easy to hide in code protected by legal and real secrecy. Even after billions of dollars of fines have been levied, underfunded regulators may have only scratched the surface of this troubling behavior. Frank Pasquale exposes how powerful interests abuse secrecy for profit and explains ways to rein them in. Demanding transparency is only the first step. An intelligible society would assure that key decisions of its most important firms are fair, nondiscriminatory, and open to criticism. Silicon Valley and Wall Street need to accept as much accountability as they impose on others.

The Black Box Society

The Black Box Society

Author: Frank Pasquale

Publisher: Harvard University Press

Published: 2015-01-05

Total Pages: 320

ISBN-13: 0674368274

DOWNLOAD EBOOK

Every day, corporations are connecting the dots about our personal behavior—silently scrutinizing clues left behind by our work habits and Internet use. The data compiled and portraits created are incredibly detailed, to the point of being invasive. But who connects the dots about what firms are doing with this information? The Black Box Society argues that we all need to be able to do so—and to set limits on how big data affects our lives. Hidden algorithms can make (or ruin) reputations, decide the destiny of entrepreneurs, or even devastate an entire economy. Shrouded in secrecy and complexity, decisions at major Silicon Valley and Wall Street firms were long assumed to be neutral and technical. But leaks, whistleblowers, and legal disputes have shed new light on automated judgment. Self-serving and reckless behavior is surprisingly common, and easy to hide in code protected by legal and real secrecy. Even after billions of dollars of fines have been levied, underfunded regulators may have only scratched the surface of this troubling behavior. Frank Pasquale exposes how powerful interests abuse secrecy for profit and explains ways to rein them in. Demanding transparency is only the first step. An intelligible society would assure that key decisions of its most important firms are fair, nondiscriminatory, and open to criticism. Silicon Valley and Wall Street need to accept as much accountability as they impose on others.


Book Synopsis The Black Box Society by : Frank Pasquale

Download or read book The Black Box Society written by Frank Pasquale and published by Harvard University Press. This book was released on 2015-01-05 with total page 320 pages. Available in PDF, EPUB and Kindle. Book excerpt: Every day, corporations are connecting the dots about our personal behavior—silently scrutinizing clues left behind by our work habits and Internet use. The data compiled and portraits created are incredibly detailed, to the point of being invasive. But who connects the dots about what firms are doing with this information? The Black Box Society argues that we all need to be able to do so—and to set limits on how big data affects our lives. Hidden algorithms can make (or ruin) reputations, decide the destiny of entrepreneurs, or even devastate an entire economy. Shrouded in secrecy and complexity, decisions at major Silicon Valley and Wall Street firms were long assumed to be neutral and technical. But leaks, whistleblowers, and legal disputes have shed new light on automated judgment. Self-serving and reckless behavior is surprisingly common, and easy to hide in code protected by legal and real secrecy. Even after billions of dollars of fines have been levied, underfunded regulators may have only scratched the surface of this troubling behavior. Frank Pasquale exposes how powerful interests abuse secrecy for profit and explains ways to rein them in. Demanding transparency is only the first step. An intelligible society would assure that key decisions of its most important firms are fair, nondiscriminatory, and open to criticism. Silicon Valley and Wall Street need to accept as much accountability as they impose on others.

New Laws of Robotics

New Laws of Robotics

Author: Frank Pasquale

Publisher: Harvard University Press

Published: 2020-10-27

Total Pages: 345

ISBN-13: 0674975227

DOWNLOAD EBOOK

AI is poised to disrupt our work and our lives. We can harness these technologies rather than fall captive to them—but only through wise regulation. Too many CEOs tell a simple story about the future of work: if a machine can do what you do, your job will be automated. They envision everyone from doctors to soldiers rendered superfluous by ever-more-powerful AI. They offer stark alternatives: make robots or be replaced by them. Another story is possible. In virtually every walk of life, robotic systems can make labor more valuable, not less. Frank Pasquale tells the story of nurses, teachers, designers, and others who partner with technologists, rather than meekly serving as data sources for their computerized replacements. This cooperation reveals the kind of technological advance that could bring us all better health care, education, and more, while maintaining meaningful work. These partnerships also show how law and regulation can promote prosperity for all, rather than a zero-sum race of humans against machines. How far should AI be entrusted to assume tasks once performed by humans? What is gained and lost when it does? What is the optimal mix of robotic and human interaction? New Laws of Robotics makes the case that policymakers must not allow corporations or engineers to answer these questions alone. The kind of automation we get—and who it benefits—will depend on myriad small decisions about how to develop AI. Pasquale proposes ways to democratize that decision making, rather than centralize it in unaccountable firms. Sober yet optimistic, New Laws of Robotics offers an inspiring vision of technological progress, in which human capacities and expertise are the irreplaceable center of an inclusive economy.


Book Synopsis New Laws of Robotics by : Frank Pasquale

Download or read book New Laws of Robotics written by Frank Pasquale and published by Harvard University Press. This book was released on 2020-10-27 with total page 345 pages. Available in PDF, EPUB and Kindle. Book excerpt: AI is poised to disrupt our work and our lives. We can harness these technologies rather than fall captive to them—but only through wise regulation. Too many CEOs tell a simple story about the future of work: if a machine can do what you do, your job will be automated. They envision everyone from doctors to soldiers rendered superfluous by ever-more-powerful AI. They offer stark alternatives: make robots or be replaced by them. Another story is possible. In virtually every walk of life, robotic systems can make labor more valuable, not less. Frank Pasquale tells the story of nurses, teachers, designers, and others who partner with technologists, rather than meekly serving as data sources for their computerized replacements. This cooperation reveals the kind of technological advance that could bring us all better health care, education, and more, while maintaining meaningful work. These partnerships also show how law and regulation can promote prosperity for all, rather than a zero-sum race of humans against machines. How far should AI be entrusted to assume tasks once performed by humans? What is gained and lost when it does? What is the optimal mix of robotic and human interaction? New Laws of Robotics makes the case that policymakers must not allow corporations or engineers to answer these questions alone. The kind of automation we get—and who it benefits—will depend on myriad small decisions about how to develop AI. Pasquale proposes ways to democratize that decision making, rather than centralize it in unaccountable firms. Sober yet optimistic, New Laws of Robotics offers an inspiring vision of technological progress, in which human capacities and expertise are the irreplaceable center of an inclusive economy.

Black Box Thinking

Black Box Thinking

Author: Matthew Syed

Publisher: Penguin

Published: 2015-11-03

Total Pages: 320

ISBN-13: 069840887X

DOWNLOAD EBOOK

Nobody wants to fail. But in highly complex organizations, success can happen only when we confront our mistakes, learn from our own version of a black box, and create a climate where it’s safe to fail. We all have to endure failure from time to time, whether it’s underperforming at a job interview, flunking an exam, or losing a pickup basketball game. But for people working in safety-critical industries, getting it wrong can have deadly consequences. Consider the shocking fact that preventable medical error is the third-biggest killer in the United States, causing more than 400,000 deaths every year. More people die from mistakes made by doctors and hospitals than from traffic accidents. And most of those mistakes are never made public, because of malpractice settlements with nondisclosure clauses. For a dramatically different approach to failure, look at aviation. Every passenger aircraft in the world is equipped with an almost indestructible black box. Whenever there’s any sort of mishap, major or minor, the box is opened, the data is analyzed, and experts figure out exactly what went wrong. Then the facts are published and procedures are changed, so that the same mistakes won’t happen again. By applying this method in recent decades, the industry has created an astonishingly good safety record. Few of us put lives at risk in our daily work as surgeons and pilots do, but we all have a strong interest in avoiding predictable and preventable errors. So why don’t we all embrace the aviation approach to failure rather than the health-care approach? As Matthew Syed shows in this eye-opening book, the answer is rooted in human psychology and organizational culture. Syed argues that the most important determinant of success in any field is an acknowledgment of failure and a willingness to engage with it. Yet most of us are stuck in a relationship with failure that impedes progress, halts innovation, and damages our careers and personal lives. We rarely acknowledge or learn from failure—even though we often claim the opposite. We think we have 20/20 hindsight, but our vision is usually fuzzy. Syed draws on a wide range of sources—from anthropology and psychology to history and complexity theory—to explore the subtle but predictable patterns of human error and our defensive responses to error. He also shares fascinating stories of individuals and organizations that have successfully embraced a black box approach to improvement, such as David Beckham, the Mercedes F1 team, and Dropbox.


Book Synopsis Black Box Thinking by : Matthew Syed

Download or read book Black Box Thinking written by Matthew Syed and published by Penguin. This book was released on 2015-11-03 with total page 320 pages. Available in PDF, EPUB and Kindle. Book excerpt: Nobody wants to fail. But in highly complex organizations, success can happen only when we confront our mistakes, learn from our own version of a black box, and create a climate where it’s safe to fail. We all have to endure failure from time to time, whether it’s underperforming at a job interview, flunking an exam, or losing a pickup basketball game. But for people working in safety-critical industries, getting it wrong can have deadly consequences. Consider the shocking fact that preventable medical error is the third-biggest killer in the United States, causing more than 400,000 deaths every year. More people die from mistakes made by doctors and hospitals than from traffic accidents. And most of those mistakes are never made public, because of malpractice settlements with nondisclosure clauses. For a dramatically different approach to failure, look at aviation. Every passenger aircraft in the world is equipped with an almost indestructible black box. Whenever there’s any sort of mishap, major or minor, the box is opened, the data is analyzed, and experts figure out exactly what went wrong. Then the facts are published and procedures are changed, so that the same mistakes won’t happen again. By applying this method in recent decades, the industry has created an astonishingly good safety record. Few of us put lives at risk in our daily work as surgeons and pilots do, but we all have a strong interest in avoiding predictable and preventable errors. So why don’t we all embrace the aviation approach to failure rather than the health-care approach? As Matthew Syed shows in this eye-opening book, the answer is rooted in human psychology and organizational culture. Syed argues that the most important determinant of success in any field is an acknowledgment of failure and a willingness to engage with it. Yet most of us are stuck in a relationship with failure that impedes progress, halts innovation, and damages our careers and personal lives. We rarely acknowledge or learn from failure—even though we often claim the opposite. We think we have 20/20 hindsight, but our vision is usually fuzzy. Syed draws on a wide range of sources—from anthropology and psychology to history and complexity theory—to explore the subtle but predictable patterns of human error and our defensive responses to error. He also shares fascinating stories of individuals and organizations that have successfully embraced a black box approach to improvement, such as David Beckham, the Mercedes F1 team, and Dropbox.

Exploring the Black Box

Exploring the Black Box

Author: Nathan Rosenberg

Publisher: Cambridge University Press

Published: 1994-03-10

Total Pages: 288

ISBN-13: 9780521459556

DOWNLOAD EBOOK

The process of technological change takes a wide variety of forms. Propositions that may be accurate when referring to the pharmaceutical industry may be totally inappropriate when applied to the aircraft industry or to computers or forest products. The central theme of Nathan Rosenberg's new book is the idea that technological changes are often 'path dependent', in the sense that their form and direction tend to be influenced strongly by the particular sequence of earlier events out of which a new technology has emerged. The book advances the understanding of technological change by explictly recognising its essential diversity and path-dependent nature. Individual chapters explore the particular features of new technologies in different historical and sectoral contexts. This book presents a unique account of how technological change is generated and the processes by which improved technologies are introduced.


Book Synopsis Exploring the Black Box by : Nathan Rosenberg

Download or read book Exploring the Black Box written by Nathan Rosenberg and published by Cambridge University Press. This book was released on 1994-03-10 with total page 288 pages. Available in PDF, EPUB and Kindle. Book excerpt: The process of technological change takes a wide variety of forms. Propositions that may be accurate when referring to the pharmaceutical industry may be totally inappropriate when applied to the aircraft industry or to computers or forest products. The central theme of Nathan Rosenberg's new book is the idea that technological changes are often 'path dependent', in the sense that their form and direction tend to be influenced strongly by the particular sequence of earlier events out of which a new technology has emerged. The book advances the understanding of technological change by explictly recognising its essential diversity and path-dependent nature. Individual chapters explore the particular features of new technologies in different historical and sectoral contexts. This book presents a unique account of how technological change is generated and the processes by which improved technologies are introduced.

The Black Box

The Black Box

Author: Marquett Burton

Publisher: Sasn

Published: 2020-08-09

Total Pages: 284

ISBN-13: 9780578745060

DOWNLOAD EBOOK

The Black Box is not a tale of a great man. This story is about someone like you: a human being endeavoring to make tomorrow better than today. Each chapter recounts a formative experience and concludes with a 'Black Box': an explanation of how a given situation helped me develop the mindset required to thrive in that type of environment.An airplane's black box records all circumstantial things occurring around and within the aircraft, as well as the voices (and radio transmissions) in the head of the airliner. When an airplane crashes engineers look into the black box to study what went wrong. However, black boxes also have stories of success, but we rarely look to them for those narratives. Memories, like a black box, are nearly permanent records. Black boxes are stored in reinforced shells designed to survive 30 minutes in 2000-degree Fahrenheit heat as well as submersion in 20,000 feet deep water.Your black box is filled with helpful memories, but so often you fail to look into your black box to pull wisdom from it. Sometimes we do not want to open the black box and look in because it means seeing our hardships replayed, seeing things that cause us fear and pain. As you peer into my black box, it will inspires you to look into your own. Our black boxes are filled with explanations of why we crash as well as stories of how we have soared above turbulence.Most of these chapters have been developed as self encapsulated stories from which a moral can be drawn without reference to previous chapters. I share the story of my life knowing that my achievements outstrip those of the average person by only a modest margin. The validity of this work lies in the distance between my starting point and where I stand today. This book is about you. It should drive you to consult your black box as you adventure through life, and to use the experience, strength and resolve that you already have to make your journey easier and more enjoyable.


Book Synopsis The Black Box by : Marquett Burton

Download or read book The Black Box written by Marquett Burton and published by Sasn. This book was released on 2020-08-09 with total page 284 pages. Available in PDF, EPUB and Kindle. Book excerpt: The Black Box is not a tale of a great man. This story is about someone like you: a human being endeavoring to make tomorrow better than today. Each chapter recounts a formative experience and concludes with a 'Black Box': an explanation of how a given situation helped me develop the mindset required to thrive in that type of environment.An airplane's black box records all circumstantial things occurring around and within the aircraft, as well as the voices (and radio transmissions) in the head of the airliner. When an airplane crashes engineers look into the black box to study what went wrong. However, black boxes also have stories of success, but we rarely look to them for those narratives. Memories, like a black box, are nearly permanent records. Black boxes are stored in reinforced shells designed to survive 30 minutes in 2000-degree Fahrenheit heat as well as submersion in 20,000 feet deep water.Your black box is filled with helpful memories, but so often you fail to look into your black box to pull wisdom from it. Sometimes we do not want to open the black box and look in because it means seeing our hardships replayed, seeing things that cause us fear and pain. As you peer into my black box, it will inspires you to look into your own. Our black boxes are filled with explanations of why we crash as well as stories of how we have soared above turbulence.Most of these chapters have been developed as self encapsulated stories from which a moral can be drawn without reference to previous chapters. I share the story of my life knowing that my achievements outstrip those of the average person by only a modest margin. The validity of this work lies in the distance between my starting point and where I stand today. This book is about you. It should drive you to consult your black box as you adventure through life, and to use the experience, strength and resolve that you already have to make your journey easier and more enjoyable.

Oxford Handbook of Ethics of AI

Oxford Handbook of Ethics of AI

Author: Markus D. Dubber

Publisher: Oxford University Press

Published: 2020-06-30

Total Pages: 1000

ISBN-13: 0190067411

DOWNLOAD EBOOK

This volume tackles a quickly-evolving field of inquiry, mapping the existing discourse as part of a general attempt to place current developments in historical context; at the same time, breaking new ground in taking on novel subjects and pursuing fresh approaches. The term "A.I." is used to refer to a broad range of phenomena, from machine learning and data mining to artificial general intelligence. The recent advent of more sophisticated AI systems, which function with partial or full autonomy and are capable of tasks which require learning and 'intelligence', presents difficult ethical questions, and has drawn concerns from many quarters about individual and societal welfare, democratic decision-making, moral agency, and the prevention of harm. This work ranges from explorations of normative constraints on specific applications of machine learning algorithms today-in everyday medical practice, for instance-to reflections on the (potential) status of AI as a form of consciousness with attendant rights and duties and, more generally still, on the conceptual terms and frameworks necessarily to understand tasks requiring intelligence, whether "human" or "A.I."


Book Synopsis Oxford Handbook of Ethics of AI by : Markus D. Dubber

Download or read book Oxford Handbook of Ethics of AI written by Markus D. Dubber and published by Oxford University Press. This book was released on 2020-06-30 with total page 1000 pages. Available in PDF, EPUB and Kindle. Book excerpt: This volume tackles a quickly-evolving field of inquiry, mapping the existing discourse as part of a general attempt to place current developments in historical context; at the same time, breaking new ground in taking on novel subjects and pursuing fresh approaches. The term "A.I." is used to refer to a broad range of phenomena, from machine learning and data mining to artificial general intelligence. The recent advent of more sophisticated AI systems, which function with partial or full autonomy and are capable of tasks which require learning and 'intelligence', presents difficult ethical questions, and has drawn concerns from many quarters about individual and societal welfare, democratic decision-making, moral agency, and the prevention of harm. This work ranges from explorations of normative constraints on specific applications of machine learning algorithms today-in everyday medical practice, for instance-to reflections on the (potential) status of AI as a form of consciousness with attendant rights and duties and, more generally still, on the conceptual terms and frameworks necessarily to understand tasks requiring intelligence, whether "human" or "A.I."

Configuring the Networked Self

Configuring the Networked Self

Author: Julie E. Cohen

Publisher: Yale University Press

Published: 2012-01-24

Total Pages: 351

ISBN-13: 0300125437

DOWNLOAD EBOOK

The legal and technical rules governing flows of information are out of balance, argues Julie E. Cohen in this original analysis of information law and policy. Flows of cultural and technical information are overly restricted, while flows of personal information often are not restricted at all. The author investigates the institutional forces shaping the emerging information society and the contradictions between those forces and the ways that people use information and information technologies in their everyday lives. She then proposes legal principles to ensure that people have ample room for cultural and material participation as well as greater control over the boundary conditions that govern flows of information to, from, and about them.


Book Synopsis Configuring the Networked Self by : Julie E. Cohen

Download or read book Configuring the Networked Self written by Julie E. Cohen and published by Yale University Press. This book was released on 2012-01-24 with total page 351 pages. Available in PDF, EPUB and Kindle. Book excerpt: The legal and technical rules governing flows of information are out of balance, argues Julie E. Cohen in this original analysis of information law and policy. Flows of cultural and technical information are overly restricted, while flows of personal information often are not restricted at all. The author investigates the institutional forces shaping the emerging information society and the contradictions between those forces and the ways that people use information and information technologies in their everyday lives. She then proposes legal principles to ensure that people have ample room for cultural and material participation as well as greater control over the boundary conditions that govern flows of information to, from, and about them.

Opening the Black Box

Opening the Black Box

Author: Helene Grandvoinnet

Publisher: World Bank Publications

Published: 2015-04-17

Total Pages: 348

ISBN-13: 1464804826

DOWNLOAD EBOOK

Opening the Black Box: Contextual Drivers of Social Accountability fills an important knowledge gap by providing guidance on how to assess contextual drivers of social accountability effectiveness. This publication aims to more strategically support citizen engagement at the country level and for a specific issue or problem. The report proposes a novel framing of social accountability as the interplay of constitutive elements: citizen action and state action, supported by three enabling levers: civic mobilization, interface and information. For each of these constitutive elements, the report identifies 'drivers' of contextual effectiveness which take into account a broad range of contextual factors (e.g., social, political and intervention-based, including information and communication technologies). Opening the Black Box offers detailed guidance on how to assess each driver. It also applies the framework at two levels. At the country level, the report looks at 'archetypes' of challenging country contexts, such as regimes with no formal space or full support for citizen-state engagement and fragile and conflict-affected situations. The report also illustrates the use of the framework to analyze specific social accountability interventions through four case studies: Sierra Leone, Pakistan, Yemen, and the Kyrgyz Republic.


Book Synopsis Opening the Black Box by : Helene Grandvoinnet

Download or read book Opening the Black Box written by Helene Grandvoinnet and published by World Bank Publications. This book was released on 2015-04-17 with total page 348 pages. Available in PDF, EPUB and Kindle. Book excerpt: Opening the Black Box: Contextual Drivers of Social Accountability fills an important knowledge gap by providing guidance on how to assess contextual drivers of social accountability effectiveness. This publication aims to more strategically support citizen engagement at the country level and for a specific issue or problem. The report proposes a novel framing of social accountability as the interplay of constitutive elements: citizen action and state action, supported by three enabling levers: civic mobilization, interface and information. For each of these constitutive elements, the report identifies 'drivers' of contextual effectiveness which take into account a broad range of contextual factors (e.g., social, political and intervention-based, including information and communication technologies). Opening the Black Box offers detailed guidance on how to assess each driver. It also applies the framework at two levels. At the country level, the report looks at 'archetypes' of challenging country contexts, such as regimes with no formal space or full support for citizen-state engagement and fragile and conflict-affected situations. The report also illustrates the use of the framework to analyze specific social accountability interventions through four case studies: Sierra Leone, Pakistan, Yemen, and the Kyrgyz Republic.

Gerri Major's Black Society

Gerri Major's Black Society

Author: Gerri Major

Publisher: Johnson Publishing Company (IL)

Published: 1976

Total Pages: 440

ISBN-13:

DOWNLOAD EBOOK

Gerri Major, the late, former Society Editor for "Ebony" and "Jet" Magazines, with Doris E. Saunders answers questions about black society from the 1700 to the mid 1970's. "Black Society" was written from the point of view of a woman who spent half-a-century chronicling the activities of this often alluded to, but largely unknown class of Americans. It describes the significant role played and contributions made by the black upper-class within the historical context of the past two hundred years in American history. Photographs, Genealogies, Bibliography, Indexed.


Book Synopsis Gerri Major's Black Society by : Gerri Major

Download or read book Gerri Major's Black Society written by Gerri Major and published by Johnson Publishing Company (IL). This book was released on 1976 with total page 440 pages. Available in PDF, EPUB and Kindle. Book excerpt: Gerri Major, the late, former Society Editor for "Ebony" and "Jet" Magazines, with Doris E. Saunders answers questions about black society from the 1700 to the mid 1970's. "Black Society" was written from the point of view of a woman who spent half-a-century chronicling the activities of this often alluded to, but largely unknown class of Americans. It describes the significant role played and contributions made by the black upper-class within the historical context of the past two hundred years in American history. Photographs, Genealogies, Bibliography, Indexed.