Skip to content

GH-300 · Domain 1: Use GitHub Copilot responsibly · 19% of the exam

Task 1.1: Understand responsible AI principles

The risks and limitations of generative AI tools, the six principles GitHub follows for responsible AI, and the harms of AI use with the mitigations that reduce them.

Study it

  • Risks and limitations of generative AI: hallucination, bias, insecure code and overreliance

    Partly covered by: What Is an LLM, Evaluating LLMs

  • The six principles of responsible AI that GitHub follows

    Lesson coming

  • Harms of AI use and the mitigations: filters, human oversight and guardrails

    Partly covered by: Guardrails

Sample questions

Try each one before opening the answer. Every option is explained, with the GitHub documentation page that proves it.

Question 1 · choose 2

An internal AI platform team adopts the responsible AI principles that GitHub follows for Copilot. For the transparency principle, they must pick the practices that put it into effect. Which practices fit that principle? (Choose TWO.)

  1. APseudonymize personal data before it is used to train or evaluate the model
  2. BDocument how the system operates and be honest about what it can and cannot do
  3. CTest the model with balanced demographic samples and monitor results per user segment
  4. DEnable logging, reporting and auditing so the system's behavior can be reviewed
  5. EOffer screen-reader support and captions so that people with disabilities can use the tool
Show the answer and why
  • APseudonymize personal data before it is used to train or evaluate the model

    Incorrect

    Pseudonymization and aggregation are practices of the privacy and security principle.

  • BDocument how the system operates and be honest about what it can and cannot do

    Correct

    Explaining how the system works and being honest about capabilities and limitations is how the transparency principle is described.

  • CTest the model with balanced demographic samples and monitor results per user segment

    Incorrect

    Balanced testing and per-segment monitoring are techniques of the fairness principle.

  • DEnable logging, reporting and auditing so the system's behavior can be reviewed

    Correct

    Enabling auditability through logging, reporting and auditing is part of the transparency principle.

  • EOffer screen-reader support and captions so that people with disabilities can use the tool

    Incorrect

    Alternative modes of interaction for people with disabilities belong to the inclusiveness principle.

Transparency is one of the six responsible AI principles that GitHub follows. It means AI systems should be understandable: creators explain how the systems operate, justify design choices, are honest about capabilities and limitations, and enable auditability with logging, reporting and auditing.

Question 2 · choose 1

In a hospital scheduling service, a developer accepts a Copilot Chat answer that looks correct and ships it without tests. The code silently double-books operating rooms on daylight-saving days. Copilot's application card names a specific risk for this pattern of behavior. Which risk is it?

  1. AOverreliance, because an incorrect output was accepted as if it were correct
  2. BData exfiltration, because scheduling data left the hospital network through chat
  3. CPrompt injection, because the request was altered on its way to the model
  4. DModel drift, because the model's quality degraded after deployment
Show the answer and why
  • AOverreliance, because an incorrect output was accepted as if it were correct

    Correct

    The card defines overreliance as users accepting incorrect or incomplete AI outputs, mainly because the mistakes are hard to detect.

  • BData exfiltration, because scheduling data left the hospital network through chat

    Incorrect

    Nothing in the scenario involves data leaving the network; the harm came from unchecked output.

  • CPrompt injection, because the request was altered on its way to the model

    Incorrect

    Prompt injection is hidden or malicious instructions entering the prompt; nothing like that happened here.

  • DModel drift, because the model's quality degraded after deployment

    Incorrect

    Drift is not the cause here: the problem is that the output was trusted without verification.

The Copilot Chat application card warns about overreliance: users accept incorrect or incomplete AI outputs, mainly because mistakes in AI outputs may be hard to detect. In consequential or sensitive domains such as healthcare, the card asks users to exercise caution, keep human oversight and verify responses before relying on them.

Question 3 · choose 1

A team maintains a large codebase in a niche functional language that has very few public repositories. They notice Copilot's inline suggestions are noticeably weaker there than in their TypeScript services. What does the inline suggestions application card give as the reason?

  1. ASuggestion quality depends on the volume and diversity of training data for each language
  2. BCopilot disables code completion for languages that have no official IDE plugin from GitHub
  3. CContent filters remove most suggestions in languages that the filters cannot parse
  4. DCopilot needs a custom instructions file before it can suggest code in a less common language
Show the answer and why
  • ASuggestion quality depends on the volume and diversity of training data for each language

    Correct

    The card states that quality varies by language with the volume and diversity of training data, and that less-represented languages can be harder to assist with.

  • BCopilot disables code completion for languages that have no official IDE plugin from GitHub

    Incorrect

    No such rule exists; suggestions work across a broad range of languages.

  • CContent filters remove most suggestions in languages that the filters cannot parse

    Incorrect

    Content filters target harmful, offensive or insecure output, not unfamiliar languages.

  • DCopilot needs a custom instructions file before it can suggest code in a less common language

    Incorrect

    Custom instructions add context, but the card attributes the gap to training data coverage.

The application card lists limited scope as a limitation: inline suggestions are trained on a large body of code, and for each language the quality depends on the volume and diversity of training data. JavaScript is well represented and one of the best supported languages; languages with less representation in public repositories may be more challenging.

Question 4 · choose 2

A team lead is drafting a training slide on the limits of Copilot inline suggestions and wants only statements that the inline suggestions application card supports. Which statements should stay on the slide? (Choose TWO.)

  1. ASuggestions use the code being written, so they may miss larger design or architectural problems
  2. BSuggestions are compiled and type-checked before they appear, so syntax errors cannot be shown
  3. CAlthough the probability is low, a suggestion can match code that was in the training set
  4. DWhen the public code filter is set to allow, Copilot stops generating new code and only copies existing code
  5. EContent filters guarantee that no insecure code pattern is ever suggested to a developer
Show the answer and why
  • ASuggestions use the code being written, so they may miss larger design or architectural problems

    Correct

    The card says inline suggestions can only suggest code based on the context being written, so they may not identify larger design or architectural issues.

  • BSuggestions are compiled and type-checked before they appear, so syntax errors cannot be shown

    Incorrect

    The card warns that generated code may not be syntactically or semantically correct.

  • CAlthough the probability is low, a suggestion can match code that was in the training set

    Correct

    The card lists matches with public code as a limitation: the probability is low but it can happen.

  • DWhen the public code filter is set to allow, Copilot stops generating new code and only copies existing code

    Incorrect

    The filter setting only decides whether matches are blocked or shown with references; generation itself is probabilistic.

  • EContent filters guarantee that no insecure code pattern is ever suggested to a developer

    Incorrect

    Filters reduce harmful or insecure output, but the card still tells users to review and test generated code.

The inline suggestions card lists limited scope (including not identifying larger design or architectural issues), potential biases, security risks, matches with public code (low probability), and inaccurate code that may not be correct. Users are responsible for reviewing and validating suggestions before accepting them.

Question 5 · choose 1

A risk officer has to map the AI governance of the tools the company buys onto an external framework. GitHub's Trust Center says how its implementation of the six responsible AI principles lines up with a government framework. Which framework and functions does it name?

  1. AISO/IEC 27001 controls for planning, doing, checking and acting
  2. BThe OWASP Top 10 for large language model applications
  3. CSOC 2 trust services criteria for security and availability
  4. DThe NIST AI Risk Management Framework: govern, map, measure and manage
Show the answer and why
  • AISO/IEC 27001 controls for planning, doing, checking and acting

    Incorrect

    The Trust Center does not tie the six principles to ISO/IEC 27001.

  • BThe OWASP Top 10 for large language model applications

    Incorrect

    OWASP's list is a catalog of vulnerabilities, not the framework named in the Trust Center.

  • CSOC 2 trust services criteria for security and availability

    Incorrect

    SOC 2 is an audit report standard, not the framework the Trust Center maps the principles to.

  • DThe NIST AI Risk Management Framework: govern, map, measure and manage

    Correct

    The Trust Center says the six principles align with the NIST AI RMF functions govern, map, measure and manage.

GitHub follows Microsoft's Responsible AI Standard in designing, building and testing its AI systems. The GitHub Trust Center says the implementation of these principles aligns with the NIST AI Risk Management Framework functions: govern, map, measure and manage.

Question 6 · choose 1

GitHub says it adheres to Microsoft's six core principles of responsible AI. Which of these is not one of the six?

  1. AInclusiveness
  2. BAccountability
  3. CProfitability
  4. DFairness
Show the answer and why
  • AInclusiveness

    Incorrect

    Inclusiveness is one of the six principles.

  • BAccountability

    Incorrect

    Accountability is one of the six principles.

  • CProfitability

    Correct

    The six are fairness, reliability and safety, privacy and security, inclusiveness, transparency, and accountability; profitability is not among them.

  • DFairness

    Incorrect

    Fairness is one of the six principles.

As part of its commitment to responsible AI, GitHub adheres to Microsoft's six core principles: fairness, reliability and safety, privacy and security, inclusiveness, transparency, and accountability. They are embedded in the Responsible AI Standard that guides how AI applications are designed, built and tested.

Question 7 · choose 1

A lending tool built with AI recommends different loan terms to applicants with nearly identical finances who differ only by neighborhood. Which responsible AI principle does this outcome most directly violate?

  1. ATransparency
  2. BFairness
  3. CInclusiveness
  4. DReliability and safety
Show the answer and why
  • ATransparency

    Incorrect

    Transparency is about systems being understandable; the problem here is unequal treatment.

  • BFairness

    Correct

    Fairness asks AI systems to treat everyone fairly and give consistent recommendations to people in similar situations, such as loan applicants.

  • CInclusiveness

    Incorrect

    Inclusiveness concerns accessibility and empowering everyone, not consistent decisions between similar applicants.

  • DReliability and safety

    Incorrect

    Reliability and safety concern consistent, safe operation; the issue described is discriminatory outcomes.

The fairness principle says AI systems should treat all people fairly and avoid different impacts on similarly situated groups; in contexts such as loan applications, they should give consistent recommendations to people with similar financial situations. Techniques include reviewing training data, testing with balanced demographic samples and monitoring results across segments.

Question 8 · choose 1

A city team uses Copilot to help build a tool that screens applications for housing assistance. Beyond reviewing the code, what do Copilot's application cards ask of teams using AI for decisions like this?

  1. AUse a premium model, because premium models are certified for consequential decisions
  2. BTurn off public code matching, because sensitive domains require only original code
  3. CAvoid writing automated tests, because test data could expose applicants' personal information
  4. DLet affected people understand the decisions, appeal them and update their input data
Show the answer and why
  • AUse a premium model, because premium models are certified for consequential decisions

    Incorrect

    No model is certified for this; the guidance is about how affected people are treated.

  • BTurn off public code matching, because sensitive domains require only original code

    Incorrect

    Public code matching is unrelated to the guidance on consequential decisions.

  • CAvoid writing automated tests, because test data could expose applicants' personal information

    Incorrect

    Testing is still expected; the guidance concerns decision transparency and appeal.

  • DLet affected people understand the decisions, appeal them and update their input data

    Correct

    For consequential decisions in sensitive domains such as housing, the cards ask that impacted stakeholders can understand, appeal and update relevant input data.

Consequential decisions are those that can significantly affect a person's access to things such as housing, healthcare, employment or financial services. Copilot's application cards ask users to exercise caution in these sensitive domains and to make sure impacted stakeholders can understand how decisions are made, appeal decisions and update relevant input data.

Question 9 · choose 1

A developer accepts several Copilot inline suggestions and one of them later turns out to contain a security bug. According to the inline suggestions application card, who assumes the risks associated with generated code?

  1. AThe user who accepts and uses the generated code
  2. BGitHub, because the content filters approved the suggestion
  3. CThe provider of the model that produced the suggestion
  4. DNobody, because AI-generated code is not covered by any license
Show the answer and why
  • AThe user who accepts and uses the generated code

    Correct

    The card states that users assume all risks associated with generated code, including security vulnerabilities, bugs and IP infringement.

  • BGitHub, because the content filters approved the suggestion

    Incorrect

    Content filters reduce risk, but the card places the risk of generated code on users.

  • CThe provider of the model that produced the suggestion

    Incorrect

    The card does not shift the risk to model providers.

  • DNobody, because AI-generated code is not covered by any license

    Incorrect

    The card explicitly assigns the risks to users.

The inline suggestions application card ends its best practices with an important note: users assume all risks associated with generated code, including security vulnerabilities, bugs and IP infringement. That is why the card asks users to review, test and validate suggestions and to follow secure coding practices.

Practise domain 1 →Practise all domains →