We may earn an affiliate commission when you visit our partners.
Course image
Pete Morton

Welcome to this course on the basics of Open Source Intelligence (OSINT) for Security and Intelligence analysts.

My name is Pete Morton. I have worked in the intelligence community for over twenty years for government agencies, humanitarian groups, and commercial organizations such as General Dynamics, JP Morgan, and Amazon.

This course is designed for analysts who are new to using OSINT or who need a refresher on the latest use cases. It is not specific to a single discipline, such as information or protective security, and can provide a basic understanding of OSINT for all domains.

Read more

Welcome to this course on the basics of Open Source Intelligence (OSINT) for Security and Intelligence analysts.

My name is Pete Morton. I have worked in the intelligence community for over twenty years for government agencies, humanitarian groups, and commercial organizations such as General Dynamics, JP Morgan, and Amazon.

This course is designed for analysts who are new to using OSINT or who need a refresher on the latest use cases. It is not specific to a single discipline, such as information or protective security, and can provide a basic understanding of OSINT for all domains.

The topics we will cover in this course include:

  • What OSINT is

  • How to apply it

  • How to analyze information using OSINT

  • The importance of critical thinking and analysis in using OSINT

  • Different search techniques, tools, and software

  • Legal considerations in the ethical use of open-source intelligence.

In today's era of wide data accessibility, we have the opportunity to tap into valuable information across various fields. This data can help us find solutions to our questions, foster organizational growth, identify risks, and even save lives.

On the other hand, sifting through terabytes of data to find specific information can be challenging. This is where OSINT adds value.

Let's dive into this course, which will equip you with the necessary tools to locate and analyze intelligence effectively using Open Source.

Enroll now

What's inside

Learning objectives

  • Understand the fundamentals of osint
  • Develop critical analytical skills
  • Master effective search techniques
  • Apply privacy and ethical considerations in osint

Syllabus

Students will gain a basic understanding of what OSINT is and how it can be used to analyze various intelligence sources.

Welcome to this course on the basics of Open Source Intelligence (OSINT) for Security and Intelligence analysts.

My name is Pete Morton. I have worked in the intelligence community for over twenty years for government agencies, humanitarian groups, and commercial organizations such as General Dynamics, JP Morgan, and Amazon.

This course is designed for analysts who are new to using OSINT or who need a refresher on the latest use cases. It is not specific to a single discipline, such as information or protective security, and can provide a basic understanding of OSINT for all domains.

The topics we will cover in this course include:

  • What OSINT is

  • How to apply it

  • How to analyze information using OSINT

  • The importance of critical thinking and analysis in using OSINT

  • Different search techniques, tools, and software

  • Legal considerations in the ethical use of open-source intelligence.

In today's era of wide data accessibility, we have the opportunity to tap into valuable information across various fields. This data can help us find solutions to our questions, foster organizational growth, identify risks, and even save lives.

On the other hand, sifting through terabytes of data to find specific information can be challenging. This is where OSINT adds value.

Let's dive into this course, which will equip you with the necessary tools to locate and analyze intelligence effectively using Open Source.


Read more

Lesson 1 Title Slide

Definition and Scope of OSINT

  • Let's quickly discuss what intelligence is. People often confuse intelligence with general information. The difference between the two is simple yet essential. Intelligence refers to vital information that directly addresses specific questions related to the decision-making process. Intelligence analysts carefully sift through information within established parameters to focus their efforts and provide relevant insights based on that intelligence.

  • Various intelligence sources exist, such as signals intelligence (SIGINT), imagery intelligence (IMINT), and human intelligence (HUMINT). These are just a few examples of the intelligence types used to address critical questions.

  • Open Source Intelligence, or OSINT, covers a wide range of activities. These include monitoring news outlets, social media platforms, government and commercial databases, and even more specialized sources like academic journals. The objective is to gather actionable and relevant information from the public domain for use in decision-making processes.

Importance of OSINT

  • OSINT is crucial in various fields, including security, business, journalism, and academia. It aids in decision-making, competitive intelligence, threat and security assessments, and more. It might seem like a foreign or daunting task. Yet, many of us collect and analyze intelligence daily without realizing it.

  • Imagine you're preparing for a trip to a foreign country you've never visited. As you get ready, you may have specific questions that must be answered within a certain timeframe. Do you have the proper visa for your trip? Will you have access to necessary medication during your stay? Can you legally drive in the country with your current driver's license?

  • Gathering information about your travel destination may not seem difficult. Still, it can involve sifting through a lot of data to find answers to your questions, especially with all the travel bloggers and unvetted information available.

  • For example, you can visit a website that provides information on the different types of visas available at your destination, but is that information up to date and from the official immigration agency? You can find a list of pharmacies and medications available over the counter. However, you may use the "control f" function to search for the specific medication in question instead of reading through the entire policy on legal medicines.

  • You will likely not read all the information about your destination because you need to plan within a specific timeframe.

  • Believe it or not, you collect the information needed to make well-informed decisions and have a more enjoyable travel experience. You are finding information and analyzing intelligence.

Applications of OSINT

  • OSINT has many diverse applications. Organizations typically use OSINT to collect publicly accessible information to answer questions that help them avoid crises, mitigate risk, or gain a competitive advantage.

  • Journalists use it to develop stories, market analysts use it to identify trends, and government agencies use it to hunt criminals.

  • OSINT's versatility has proven helpful to numerous organizations across various domains.

    Security professionals use OSINT to monitor and manage a wide range of threats. The applications are extensive, spanning from physical to cybersecurity.

  • For example, in physical security, OSINT tools can search online platforms and public databases to identify potential threats to infrastructure, such as protests, planned disruptions, or even terror attacks. This proactive approach helps reduce risks and enables the efficient allocation of security resources based on the intel.

  • Cybersecurity teams use OSINT to gather data on the latest threats, such as emerging malware or phishing campaigns. And they use forums, social media, and technical blogs to gain insights into cyber adversaries' tactics, techniques, and procedures. This intelligence is crucial for developing robust defense mechanisms and alert systems that help identify potential breaches before they escalate.

  • OSINT's applications expand daily as the rapid sharing and storage of information continue to grow. I wonder how many new uses will be discovered in the next few years. You may find the next one.

Understanding OSINT's scope and significance sets the foundation for mastering its techniques. By effectively leveraging publicly available information, intelligence professionals can anticipate threats, protect assets, and maintain the upper hand in a landscape marked by constant change and unpredictability.

Categories of Open Sources

  • OSINT sources come from various places, such as media reports (print, video, and web), internet posts, social media, academic publications, geospatial data, and even the dark web. The key to understanding the various categories in which OSINT can be found is that they are publicly available.

  • Some paid sources contain information that is considered private or classified. Documents that are confidential for business and secret for the government are likely not regarded as open source.

  • Some sources collect private information and share it without permission. For example, sites like WikiLeaks may contain classified information that is openly accessible. However, it's essential to understand that using private or classified information for analysis could be illegal or unethical. If you're asked to share your research and its sources, you could cause compliance issues for your organization or void your intelligence.

  • Understanding whether your intelligence falls into an open-source category is important to ensuring ethical conduct while conducting research. We will dive deeper into this topic in lessons 7 and 8.

Overview of Primary Sources

  • Numerous sources are available for analysts to collect intelligence, and new sources are constantly emerging. Just a few years ago, OpenAI did not exist. It has changed how quickly an analyst can find and analyze information.

  • For this lesson, let’s concentrate on the internet, social media, forums, public records, and academic journals, as each offers unique insights and challenges in information gathering.

Deep Dive into Source Types

  • General Google searches on the World Wide Web are usually the starting point for OSINT. The capability to search for anything on the web yields a wide range of results that can assist analysts in finding the intelligence they need to answer their questions. Additionally, there are search techniques that can refine search results, which we will cover in lesson 5.

  • Social media platforms such as X, Facebook, Instagram, and LinkedIn provide a wide range of data that can be utilized for security purposes. From monitoring public sentiment to tracking specific events in real-time, social media serves as a valuable source of information for security analysts.

  • Forums are valuable because they provide detailed and specific information. Participants often delve into niche topics, offering insider perspectives and sharing firsthand experiences. This makes forums valuable for OSINT practitioners seeking in-depth insights into particular subjects or communities. They also allow analysts to ask questions directly in the forum.

  • Public records encompass a variety of documents, including court records, business registrations, voter registries, licenses, and regulatory documents. Government agencies maintain these records, which are legally accessible to the public. They are a crucial resource for anyone conducting open-source intelligence.

  • Academic journals contain peer-reviewed research and scholarly articles that offer thorough analysis and validated information on various topics. These journals provide credible and detailed insights for understanding complex geopolitical dynamics, technological advancements, and socio-economic trends. OSINT analysts can use academic databases to access the expertise and findings of scholars, enhancing the accuracy and depth of their intelligence assessments. Furthermore, the methodologies and references in academic papers can guide further research and validate other sources of information.

Now that you understand what OSINT is and how it is used let’s learn how to analyze the information we find. Up next, we are going to dive into search techniques and tools for OSINT.

Importance of Search Techniques

  • Understanding effective search techniques is crucial for efficient open-source intelligence (OSINT). Knowing how to filter and search alone is not sufficient. The amount of information available online is immeasurable, and search results are often personalized based on your interests rather than tailored to your organization's interests or relevancy to your research.

  • Analysts can use several techniques to conduct searches efficiently and produce accurate results. This is important because the questions you are helping to answer likely have an expiration date. There will come a time when the decision point that your intelligence is informing may pass, and that intelligence will no longer be of any value.

  • Search operators, such as quotes for exact phrases, asterisks for wildcard expansions, and Boolean operators like AND, OR, and NOT, can significantly refine your search and reduce the time spent sifting through web results. So, let's go through some of the common search operators you can use to reduce your time collecting information.

Quotation Marks

  • When you enclose a phrase in quotation marks, you are instructing the search engine to find that exact phrase. This significantly narrows down your search results to more relevant information.

  • If you are searching for a specific report on data breaches in 2023, simply type "data breach report 2023". By doing this, the results will focus specifically on documents or pages containing the exact phrase "data breach report 2023". This is especially helpful when looking for specific titles, names, or quotes.

  • Try searching for a specific phrase relevant to your work and note the difference in results when using quotation marks compared to a broad search.

Minus Sign

  • The minus sign operator excludes specific words from your search results, helping to filter out irrelevant information.

  • If you are looking for cybersecurity news but want to exclude results that require a subscription, you would type: cybersecurity news -subscription. This will remove any results that mention "subscription," giving you a cleaner set of results to work with.

  • Perform a search using the minus sign to exclude unwanted terms and observe how it refines your results.

Asterisk

  • The asterisk operator (*) serves as a wildcard, replacing one or more words in your search query. This is particularly useful when you are still determining the exact phrase.

  • To find variations of phrases like "data breach * 2023," simply type: "data breach * 2023". This will display results such as "data breach incidents 2023" or "data breach statistics 2023."

  • Try using an asterisk in a search query related to your field and observe the variety of results it returns.

Site

  • The site operator limits your search to a specific website or domain, which is helpful for finding information within a known and trusted source.

  • For example, to find annual security reports on a UK government site, you would type site:gov.uk "annual security report". This ensures that all results come from the .gov.uk domain, providing credible and official information.

  • Choose a reputable website in your field and utilize the site: operator to locate specific information within that site.

Intitle

  • The intitle operator allows you to search for specific words in the title of web pages or documents, making it easier to find relevant content.

  • To find articles with "insider threat" in the title, you would type: intitle: "insider threat". This will show results where "insider threat" is prominently featured in the title, indicating a primary focus on that topic.

  • Use the intitle: operator to find documents or pages containing your chosen keywords in the title.

Inurl

  • The inurl operator allows you to search for specific words in the URL, which can help locate documents or sections within a website.

  • To find reports related to financial fraud, use the search query inurl:report "financial fraud". This will return pages with "report" in the URL, likely detailed documents on financial fraud.

  • Now, it's your turn to try using the inurl operator. See if you can find specific types of documents within a website using this tool.

Filetype

  • The filetype: operator allows you to search for specific types of files, such as PDFs, Word documents, or Excel sheets.

  • To find PDFs on incident response plans, you would type: filetype:pdf "incident response plan". This will filter your results to show only PDF documents, which are often more detailed and structured.

  • Use the filetype: operator to find documents in your preferred format related to your field.

Related

  • The related: operator helps you find websites related to a specified site, useful for discovering new sources of information.

  • For example, to find sites related to BBC, you would type: related:bbc.com. This will show websites similar to BBC, potentially providing additional news sources or perspectives.

  • Use the related: operator to discover new websites related to your key information sources.

Combining Operators

  • Now that you are familiar with individual search operators let's combine them for more powerful searches.

  • To find PDF documents on UK government sites related to cyber security, you would type: site:gov.uk intitle:"cyber security" filetype:pdf -inurl:archive . This complex search query limits results to UK government sites, focuses on titles with "cyber security," filters for PDFs, and excludes archived pages.

  • Create a complex search query relevant to your work using multiple operators and observe how effectively it narrows down your search results.

Leveraging Social Media Search Tools

  • Social media platforms are rich sources of real-time information and relationship mapping. Mastering the use of different Social Media tools can significantly enhance your intelligence-gathering capabilities.

  • One thing to note about social media regarding the ethical use of it as an OSINT tool is that it is not a good practice, or in some cases, a legal practice, to use fake social media profiles to collect OSINT. This is almost always against the platform's policies and, in some countries, an illegal invasion of privacy. Only use Social Media as a resource if you are collecting the information ethically and if the information is for public use.

X (formerly Twitter), Facebook, Instagram, and LinkedIn Basic Search

  • Most social media platforms have a search bar that allows you to find posts containing specific words, hashtags, or phrases.

  • Suppose you want to find posts related to a data breach. You would simply type: data breach. This search will return posts containing the words "data breach." You can refine your search by adding more keywords or hashtags.

Advanced Social Media Search Operators

  • Most social media platforms support advanced search operators for more precise searches.

  • If you were looking for a specific phrase, you would use quotation marks, as we learned in the last session. For example, “data breach".

  • If you want to search hashtags, use the hashtag symbol and the word. If you are searching for a phrase, do not add spaces between the words, for example, “#databreach".

  • If you want to search posts from a specific user, search the user's handle, starting with the @symbol. For example, “@username”.

Specialized search tools for X and LinkedIn

  • In X (formerly Twitter), you have powerful tools for targeted searches. You can conduct advanced searches through the “advanced search” link or by typing the search operator directly into the search bar.

  • There are numerous search operators available in X like the to:, from:, date range, geolocation, and filter:, operators. Let's go through some of the more common advanced search operators you might use in OSINT. You can also go to the link provided in the notes to see a full list from X.

  • When looking for tweets from specific users, simply start with "to: or from:" followed by the @ symbol and their handle, like this: to:@elonmusk or from:@elonmusk.

  • To refine your search in X, exclude specific words using a minus sign, such as data breach -report, especially when dealing with large data sets.

  • Searching for specific date ranges in X is straightforward. You can use the since: and until: commands, like data breach since:2023-01-01 until:2023-12-31. This lets you pinpoint the exact time frame you need, making your search more precise and efficient.

  • To search for tweets near a specific location, which can help identify if a potential threat is nearby, you can enter the geocode:latitude,longitude,and the radius of your search (with no spaces between).

  • X Pro subscribers have access to Tweetdeck, a useful platform for creating multiple search feeds. It includes the ability to create boolean and location-based searches. For more information on using Tweetdeck, please refer to additional training specifically on these platforms from Morton Executive Decisions.

  • LinkedIn offers specialized tools like Sales Navigator, which allow users to narrow their searches based on user or company market. This information is readily available but may not be considered OSINT. Privacy laws vary from country to country. Make sure you are using the information within the parameters of the policies of the platform you are collecting from.

  • Now is your chance to use advanced social media search operators to find specific information relevant to your field.

Mastering these techniques will streamline your searches and lead to better intelligence gathering. Remember that this is an introductory course, and we are just scratching the surface of what is possible, especially regarding extensive data sets. There are numerous platforms available that we can go through in future courses.

Introduction to OSINT Platforms

  • OSINT platforms provide tools for collecting and analyzing publicly available information. They help you uncover hidden connections, monitor emerging threats, and understand the broader context of security incidents.

  • There are many free tools available that you may already be familiar with, like Google Earth, Maltego,  The Harvester, and more. There are also paid platforms that you can subscribe to, like Palentier, Dataminr, or Factal.

Introduction to Entity Relationship Mapping

  • One of the core functionalities of many OSINT platforms is entity relationship mapping. This helps you visualize and analyze relationships between entities such as people, companies, and websites.

  • Entity relationship mapping is beneficial for uncovering hidden connections and understanding complex networks.

  • To investigate a specific individual, you would create an entity for that person and then explore connections to other entities such as associates, organizations, and online profiles.

  • Numerous paid and free software tools are available for relationship mapping. Simple free tools like Canva or even Microsoft Word can be used to depict relationships visually.

Advanced Relationship Analysis

  • Advanced Relationship Analysis involves using sophisticated methods and tools to uncover and analyze the intricate connections between various entities. These entities can include individuals, organizations, domains, email addresses, phone numbers, social media profiles, and more.

  • Key Features of Advanced Relationship Analysis include;

    • Transforms and Queries are pre-configured searches that extract specific types of information, such as email addresses from a domain, social media profiles related to a person, or associations between organizations.

    • Graphical Link Analysis visualizes connections between entities in a graphical format, like Excel. This helps us understand the network and identify critical nodes and relationships. It helps see how entities are interconnected and spot hidden connections.

    • Multi-source data Integration combines data from various sources to provide a comprehensive view. Sources include public records, social media, websites, and databases, enhancing the depth and accuracy of the analysis.

    • Pattern Recognition identifies recurring patterns and trends within the data. Patterns can indicate underlying structures or common behaviors among entities, which helps predict future activities or identify anomalous behavior.

    • Temporal Analysis is analyzing the timing and sequence of events and understanding how relationships evolve. This is crucial for identifying the chronology of interactions and key moments in the network.

  • This level of analysis helps you identify key connections and potential security risks. To learn more about using these advanced relationship features, please sign up for our advanced analytical training courses in the future.

  • Check out the entity mapping exercise to test your ability to connect entities using OSINT.

Introduction to Real-Time Data Collection

  • Another essential feature of OSINT platforms is real-time data collection. This allows you to monitor live information from various sources, such as news sites, social media, and public records.

  • Real-time data collection helps you to stay informed about emerging threats and incidents as they occur. For instance, you can set up alerts for specific keywords or topics in programs like Feedly or Brand24 to receive real-time updates on relevant developments.

  • You can also track hashtags on most social media platforms to see what is trending around a specific topic or follow other vetted social media users who are already sifting through and verifying data around the issues that are relevant to you.

    Analyzing Real-Time Data

  • Analyzing real-time data involves filtering, categorizing, and interpreting the information collected to make informed decisions.

  • For instance, you can utilize filters to organize data based on relevance, date, or source and classify it to recognize patterns or trends. In X, you can track a particular user account, filter it for keywords such as "attack" or "hate," and then filter that stream by the most recent posts, alerting you when someone from that account adds a post with the words attack or hate.

  • Google Alerts allows you to monitor keywords, phrases, or data patterns across various open-source. You can limit how often you receive alerts and even create your own Really Simple Syndication or RSS feeds. RSS feeds can also be integrated into your websites and dashboards.

  • Companies like Feedly allow you to categorize, monitor, and analyze articles and social media posts. They even allow you to create your own Boolean Logic filters and crawlers, ensuring the most relevant information pops up in your feeds.

  • This analysis helps you understand the broader context of an incident and anticipate potential risks.

  • Analyze a set of real-time data collected from your alerts and identify key insights.

Introduction to Data Aggregation

  • OSINT platforms often provide tools for data aggregation, allowing you to compile information from multiple sources into a single, comprehensive view.

  • Aggregating data helps you see the bigger picture and identify connections that might not be apparent from individual sources.

  • For example, you can compile data on a specific individual from their social media accounts, mentions on news sites, and public records to create a unified profile of that user.

  • Let's dive a little deeper into the Techniques used to visualize data.

Data Visualization Techniques

  • Data visualization is a powerful feature of OSINT platforms, helping you interpret complex data through graphical representations such as charts, graphs, and maps. Visualizing data makes it easier to identify patterns, trends, and anomalies. It also makes your job of communicating your intelligence to decision-makers easier.

  • An excellent illustration of data visualization's role in OSINT is the creation of a heatmap of specific criminal actions in the United States. This tool visualizes crime-prone areas, equipping decision-makers with the necessary information to effectively mitigate risk.

  • Another use case would be to collect and categorize contacts from potential criminals' social media accounts to determine their center of gravity: the user is connected to everyone. By downloading the names of all the friends from each account into a spreadsheet, you can sort and filter to determine the user with the most connections, giving you a lead on who might be running criminal operations for that group.

  • Use the data visualization tools in the following exercise to create a graphical representation of your aggregated data.

Using these tools efficiently will amplify your OSINT efforts. It is important to note that the speed of technology is enhancing our ability to analyze data and find intelligence. It is a good practice to search for new tools often to ensure you are being as effective as possible. Next, we will address the analytical skills you need to analyze the information you have collected.

Evaluating Source Reliability

  • In the realm of open-source intelligence, the credibility of your information can significantly impact your analysis. Verification is a crucial step in intelligence, mainly when working with open-source information. It entails confirming the information's authenticity, accuracy, and reliability before utilizing it for decision-making.

  • The access to unlimited information we enjoy today is great, but it can also cause issues when searching for answers to specific questions. Sifting through the data is only part of an analyst's job. Validating sources is also critical to ensuring that we understand the accuracy of the information.

Cross-Verification with Multiple Sources

  • The most reliable method is cross-verification. Always confirm information with multiple independent sources. Check if other reputable sources report the same facts without relying on each other’s reports. This approach helps to avoid misinformation that might be widely circulated.

  • When using news or journalists as sources, it is vital to look for quotes from their sources. Many news organizations repeat reporting from the Associated Press, for example, changing very little information. You might find fifteen separate articles or videos documenting the same story, all originating from the same source.

  • Look for sources that validate each other without having collaborated. The stories should vary slightly due to differing perspectives. If the accounts are the same, there is a high likelihood that the sources collaborated on the story.

Understanding Source Bias

  • Evaluate the bias and reliability of the source. Every source has its own perspective, and understanding these biases can help you assess the information's objectivity. Consider the source's history, ownership, political leanings, and past accuracy. Generally, sources with a track record of reliability are more trustworthy.

  • It is essential to check your own biases multiple times throughout your analysis. The best way to do this is by asking for perspective from a trusted colleague you know does not always agree with you. Their analysis may differ significantly from yours, but you may see something you did not notice before, finding answers somewhere in the middle.

  • It is common to come across biased information from news, media, and professionals who often present extreme viewpoints to cater to their specific audience. Recognizing the target audience to understand the spin on the information is essential. For example, there is a noticeable difference between Fox News and CNN. You might naturally react to using one or the other as a source. We all have biases. I make it a practice to seek out sources that I may not trust. Nonetheless, I can always find key points in the information that confirm my source information. I then choose to leave the biased information alone.

Expert Opinion and Peer Reviews

  • Seeking expert opinions or peer reviews is another effective strategy. Experts in a particular field can provide insights into the accuracy of technical data and facts. Similarly, information or data peer-reviewed and corroborated by academic or professional communities often holds greater credibility.

  • It's crucial to remember that just because someone claims to be an expert doesn't necessarily mean they are right. It's important to validate your sources and the information they provide. This process is often more straightforward than you think. Most intelligence professionals conduct predictive analysis to identify potential hazards that could hinder a mission. You can assess a professional's track record to see how often they are correct.

Technical Verification Tools

  • Remember to utilize technical tools designed explicitly for verification. These tools may include reverse image search tools to authenticate images, metadata analysis tools to examine the source and history of digital files, and fact-checking websites that can help verify or debunk claims and news stories.

  • It's important to note that fact-checking websites are often operated by those who write articles for news sources. Many fact-checking resources have had to issue retractions or change their "facts" at a later date.

  • Fact-checking requires thorough investigation, which can take time. If you're fact-checking new information, verifying how the info was fact-checked and examining the fact-checker's sources and evidence is a good idea. Information fact-checked before an investigation is complete is not typically reliable.

  • With the rise of AI and the deepfake industry, identifying information's authenticity will become increasingly difficult. As validating information becomes more complex, new tools for verifying information will hopefully be created.

Adequate verification is crucial for ensuring the reliability of your OSINT. It safeguards your projects from the dangers of misinformation and improves the quality of your intelligence. With these analytical skills, you can transform raw data into valuable intelligence, answering critical questions. If you are interested in more comprehensive source identification and validation training, please consider enrolling in our advanced analysis courses.

Introduction to Critical Thinking

  • Critical thinking involves several vital skills: Analysis, Evaluation, Inference, and Explanation. Analysis means examining information in detail by breaking it down into smaller parts. Evaluation involves assessing the credibility and usefulness of information. Inference is about drawing conclusions based on the evidence and reasoning, and Explanation entails communicating your findings.

  • Critical thinking is vital in OSINT for several reasons. It helps us avoid biases, ensures data accuracy, and leads to practical interpretation. Without it, we risk making decisions based on flawed or incomplete information, which can seriously affect security contexts.

Recognizing and Mitigating Biases

  • Let's examine biases, which are systematic errors in thinking that affect judgments and decisions. We don't want mistakes in our analysis; recognizing these biases is crucial in OSINT work.

  • Some common biases include Confirmation Bias, where we favor information that confirms our existing beliefs; Availability Heuristic, where we overemphasize readily available or recent; and Anchoring Bias, where we rely too heavily on the first piece of information we see.

  • To mitigate these biases, practice challenging your assumptions. Seek out contradictory information and consider multiple perspectives before forming conclusions. Use structured analytical techniques to ensure a balanced information gathering and analysis approach.

Questioning Techniques

  • Effective questioning is a powerful tool in OSINT. It guides how we gather data and interpret it. After all, we are trying to answer questions.

  • Use Open-ended Questions to explore data more deeply. These questions encourage detailed responses and insights. Closed Questions help confirm specific details or yes/no answers, but they leave very little room to expound on.

  • Socratic questioning challenges assumptions and explores the implications of the information. Questions like 'What is the evidence for this claim?' or 'What might be an alternative explanation?' help deepen understanding and prevent superficial analysis.

Analytical Techniques for Critical Thinking

  • Understanding Deductive and Inductive Reasoning is key. Deductive reasoning starts with a general statement and reaches a specific conclusion, while inductive reasoning takes specific data and extrapolates a general rule.

  • An example of Deductive Reasoning might be: All birds have feathers. A robin is a bird, So a robin has feathers.

  • An example of Inductive Reasoning might sound like this: You observe that a swan on a lake is white. You see another swan on a different lake, and it is also white. A friend reports seeing only white swans at a nearby park. Therefore, based on that specific data, your general conclusion is that All swans are white.

  • Critical reading and listening involve evaluating the information’s source, context, and content. A good analyst must distinguish between facts, which are verifiable, opinions, which are personal views, and assumptions, which are taken for granted without proof.

  • These critical thinking skills enhance your OSINT capabilities and ensure that your conclusions are well-founded and reliable.

  • There is a ton of information available on critical thinking. This is a basic overview, but we will put some of our favorite resources in the notes section to review at your own pace.

  • If you have any questions about critical thinking, please let us know in the chat, and we will do our best to answer them promptly.

Synthesizing Information

  • Synthesizing information is a critical step in OSINT Analysis. This involves integrating various pieces of information to form a coherent understanding. Use logical reasoning to connect disparate data points and look for patterns and trends that help build a solid narrative or conclusion.

  • The most critical part of conducting analysis is digestibly delivering your conclusions to the audience. You must understand your audience and how they prefer to receive information. For example, if you were to ask an associate at Amazon how their executives like to receive information, they would tell you to present it in a six-page white paper in a specific format, with no PowerPoint allowed.

  • On the other hand, if you were presenting to a general in the US Army, they might expect you to use PowerPoint formatted in a specific way, with their unit logo in the corner of each slide. A busy executive might require condensing your research from 150 pages (not including graphics) to a single page.

  • Analysts' work often results in masterpieces. However, being a good analyst requires humility and an understanding that we are not the ones making tough decisions all day. While our work is essential, it may not always be at the top of a decision-maker's priority list.

  • To ensure your hard work pays off, it's best to make it easy to understand and straight to the point. Put the bottom line up front, with your research easily accessible for questions and answers from the decision maker. Your success is measured in organizational growth and the safety of your colleagues and customers.

Critical thinking and the ability to effectively disseminate analytical products enhance good intelligence. They enable us to navigate through misinformation and develop insights that are not only informative but also actionable. These crucial skills will ensure that your hard work is implemented and your reputation as a trustworthy analyst grows.

Understanding the legal landscape of OSINT is essential to ensure compliance and avoid legal pitfalls. This session will discuss privacy laws, intellectual property rights, and specific regulations impacting OSINT practices.

Overview of Relevant Laws

  • Different countries and even states maintain specific Privacy Laws. A few high-profile examples include;

    • General Data Protection Regulation (GDPR): Regulates the processing of individuals' personal data within the EU.

    • California Consumer Privacy Act (CCPA): Provides privacy rights to consumers in California.

    • Health Insurance Portability and Accountability Act (HIPAA): Protects sensitive patient information in the U.S.

  • There are also numerous Intellectual Property Rights policies to navigate when using OSINT:

    • Copyright Laws: Protect the use of creative works such as articles, images, and videos.

    • Trademark Laws: Protect brand names, logos, and slogans from unauthorized use.

  • There are also Specific Regulations concerning OSINT:

    • Computer Fraud and Abuse Act (CFAA): U.S. legislation governing unauthorized computer and network access.

    • Electronic Communications Privacy Act (ECPA): This act protects wire, oral, and electronic communications while they are being made, in transit, and stored on computers.

  • These are just a few examples of the many regulations and policies to consider when collecting and utilizing OSINT for business and government purposes. We have provided links to each of these for you to dive into on your own in the notes.

Types of Legally Assessable OSINT

  • Numerous sources of information are available for OSINT use, but which are legally permitted? How do you know when you might be crossing a line?

    • Publicly Available information is legally accessible and does not require special permission. Typically, there is no expectation of privacy. You can determine this by looking for source data, citations, policies on open-source databases, and different tools that list licensing requirements. Be aware that just because it's on the open net does not mean it was shared with permission.

    • Public Records are government records that are legally available to the public, such as court records, offender registries, and property deeds. Typically, government databases list requirements for using the information in their terms of service and use.

    • Publicly accessible Social Media posts and profiles that do not require a login, connection, or special access are typically legal to use in OSINT. Keep in mind that just because someone makes you a friend on Facebook and gives you access, they are not giving up their right to privacy.

Potential Legal Violations

  • Accessing private information or systems without permission or unauthorized access is unacceptable and generally illegal. This falls under the category of hacking and can result in criminal charges.

  • Data harvesting and scraping, which involve automated data collection from websites, may violate terms of service or laws. If you are using scraping software, it is essential to know where the data you are collecting is coming from. Review the website's terms of service and the privacy laws of the organization's country that owns the website.

  • Information gathered in a way that violates an individual's reasonable expectation of privacy is considered an invasion of privacy. It's important to note that collecting large data sets in this manner can lead to numerous violations, and verifying sources can be challenging. Therefore, narrowing your search as much as possible and identifying the specific source for that information is crucial to minimize violations.

Staying within legal boundaries is crucial for ethical OSINT practice. Next, we'll delve deeper into the ethical aspects and how to handle ethical dilemmas.

Developing an Ethical Framework

  • Ethics in OSINT are not just about legality. It's about integrity and responsibility. Establishing an ethical framework ensures that your intelligence gathering is conducted in a manner that is respectful, responsible, and trustworthy. This is a good practice for you as an intelligence professional and your organization.

  • Establishing components for an ethical framework is a good idea to ensure that you operate in a manner that promotes continuity and compliance for your organization and sets you up for long-term success as a professional.

Principles of an Ethical Framework for OSINT

  • Embracing professionalism is crucial. This entails upholding professional standards and codes of conduct while committing to continuous learning and observing best practices in OSINT.

  • Here are some examples of principles that you may consider integrating into your Ethical Framework.

    • Conducting your work with integrity means always acting honestly and transparently in your OSINT activities. Ensure that your collection and analysis methods, as well as your sources, are reliable and verifiable.

    • Confidentiality is all about protecting the privacy of individuals and organizations. Avoid intruding on individuals’ privacy unless absolutely necessary and legally permissible. This shows that you respect the privacy of others and will promote professionalism and increase your reputation as a trustworthy analyst.

    • Embrace accountability for your decisions and conduct. Maintain thorough documentation of your processes and be confident in articulating your methods.

Maintaining your Ethical Framework for OSINT

  • Developing a framework is great, but you must implement and maintain it. Here are some ways that you can do just that.

  • Develop clear guidelines for ethical OSINT practices and attach key performance indicators to those guidelines to ensure compliance.

  • Seek out regular training and update your guidelines to ensure that you understand and adhere to the ethical framework.

  • Continuously monitor and evaluate your practices to ensure compliance with ethical standards. Check yourself regularly.

  • As an individual, you are ultimately responsible for collecting and analyzing OSINT. Your organization may share some accountability, but generally, the analyst bears the brunt of any policy or legal violations and potential consequences.

Adhering to ethical standards is vital for maintaining the trustworthiness and reliability of your intelligence outputs. Ethical OSINT practices not only protect the rights and privacy of individuals but also ensure the integrity and credibility of your work.

Let’s engage in scenarios and role-plays to understand how to navigate ethical dilemmas you may encounter in the field. These exercises will help you apply the ethical framework in real-world situations.

We’ve covered a lot in this course, from the basics of OSINT to advanced tools and ethical considerations. Remember, the landscape of open-source intelligence is constantly evolving, and continuous learning is critical. We plan on updating this course as OSINT evolves and recommend you check back occasionally for changes. In the meantime, please feel free to submit any questions regarding this course or sign up for some of our virtual and in-person training through Morton Executive Decisions.

Thank you for all you do to keep people safe and ensure organizations continue to grow and prosper.

Traffic lights

Read about what's good
what should give you pause
and possible dealbreakers
Provides a foundational understanding of OSINT, which is essential for security professionals seeking to enhance their intelligence gathering and analytical capabilities in a rapidly evolving digital landscape
Covers legal and ethical considerations, which are crucial for analysts to ensure responsible and compliant intelligence gathering practices, thereby safeguarding individual rights and organizational integrity
Explores diverse applications of OSINT across security, business, journalism, and government, which highlights its versatility and relevance in various professional domains for informed decision-making
Examines various intelligence sources, such as media reports, social media, and academic publications, which equips analysts with a comprehensive understanding of available resources for effective information gathering
Teaches search techniques using operators and social media tools, which enables analysts to efficiently filter and refine search results, saving time and improving the accuracy of collected intelligence
Requires learners to understand privacy laws, which may vary by jurisdiction and necessitate careful consideration to ensure compliance when collecting and using open-source intelligence

Save this course

Create your own learning path. Save this course to your list so you can find it easily later.
Save

Reviews summary

Basic introduction to open source intelligence

According to learners, this course offers a solid foundation (positive) in Open Source Intelligence (OSINT) basics, particularly for beginners (positive) and those new to the field. Reviewers consistently praise the instructor's extensive real-world experience (positive) and ability to explain concepts clearly (positive) in well-structured, bite-sized modules (positive). Key strengths highlighted include the coverage of critical thinking (positive), source verification (positive), and the essential legal and ethical considerations (positive) of OSINT. While the course provides useful search techniques (positive), some students felt the section on specific OSINT platforms and tools (warning) was more of an overview than practical, hands-on instruction, leaving them wanting more detail. Overall, it is considered an excellent starting point (positive) but may be too introductory for experienced analysts.
Course content is logical and easy to follow.
"The modules were well-structured and easy to follow."
"The course structure is logical, moving from theory to practical search methods and tools."
"The course structure is logical, progressing smoothly from fundamental concepts to more specific techniques..."
"The content is well-organized and easy to digest."
"The structure is logical, and each module builds nicely on the last."
Focus on critical thinking, verification, and bias is key.
"The critical thinking module was a highlight."
"The legal and ethical considerations were also well-covered and very important in this field."
"the focus on critical thinking and ethics is definitely a strong point."
"The coverage of identifying reliable sources and understanding bias was particularly enlightening and feels essential..."
"The emphasis on critical thinking and source verification is extremely valuable."
"The legal and ethical modules were excellent and necessary."
"I particularly valued the sections on critical thinking and verifying sources – skills applicable far beyond OSINT."
Instructor's background and teaching style are highly valued.
"The lecturer, Pete Morton, was highly engaging and knowledgeable, clearly drawing from extensive real-world experience."
"The instructor's expertise is evident, and he explains complex ideas clearly."
"Pete Morton is clearly an expert and his insights are valuable."
"The instructor's background and practical experience shine through, making the content highly relevant and credible."
"Instructor clearly knows his stuff."
"The instructor is highly experienced and explains everything very clearly."
Provides essential basics and overview for newcomers.
"This was a very good basic course on OSINT. ... The course provided a solid foundation covering the definition, importance, applications, and categories of OSINT sources."
"Excellent foundational course! As someone completely new to OSINT, I found this course incredibly accessible and informative."
"Solid foundational knowledge provided. ... Good value for a beginner's course."
"This course is an excellent starting point for anyone interested in OSINT."
"Highly recommend this course for beginners! ... provides the crucial groundwork. A truly 'basic' yet comprehensive overview."
"It's perfect for beginners but might be too introductory for experienced analysts seeking deep dives..."
Overview of tools is provided, but not detailed usage.
"I felt the coverage of specific OSINT platforms and tools was a bit too brief. It gave an overview but didn't go into enough detail for practical implementation..."
"My main critique is that the 'tools' section felt more like a list of tools rather than a guide on *how* to use them effectively."
"The section on search operators was useful, but the tools section felt more like an advertisement for advanced courses rather than practical instruction."
"I agree with others that the practical application of tools wasn't as detailed as I'd hoped..."
"The practical side, particularly the tools, is just an overview. If you're looking for hands-on experience with specific software, this course isn't it."

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Basic Open Source Intelligence Analysis with these activities:
Review Key Legal Concepts
Reinforce your understanding of privacy laws and regulations before delving into OSINT techniques.
Browse courses on GDPR
Show steps
  • Identify key privacy laws relevant to OSINT.
  • Summarize the main points of each law.
  • Consider how these laws impact OSINT practices.
Review 'The Psychology of Intelligence Analysis'
Improve your critical thinking skills by understanding the psychology of intelligence analysis.
Show steps
  • Read the book's introduction and table of contents.
  • Focus on chapters related to cognitive biases.
  • Identify strategies for mitigating these biases.
Review 'Open Source Intelligence Techniques'
Expand your knowledge of OSINT techniques with a practical guide.
Show steps
  • Read the book's introduction and table of contents.
  • Select chapters relevant to the course syllabus.
  • Summarize key takeaways from each chapter.
Four other activities
Expand to see all activities and additional details
Show all seven activities
Advanced Search Operator Exercises
Improve your search skills by practicing advanced search operators on various search engines.
Show steps
  • Choose a search engine (e.g., Google, DuckDuckGo).
  • Create a list of advanced search operators.
  • Practice using these operators to refine searches.
  • Document your findings and search strategies.
Develop an OSINT Tool Comparison Matrix
Deepen your understanding of OSINT tools by creating a comparison matrix.
Show steps
  • Identify a range of OSINT tools.
  • Define criteria for comparison (e.g., cost, features).
  • Evaluate each tool based on the defined criteria.
  • Create a matrix summarizing your findings.
Create a Threat Landscape Report
Solidify your understanding of OSINT by creating a report on a specific threat landscape.
Show steps
  • Select a specific threat landscape (e.g., cybercrime, terrorism).
  • Gather OSINT data related to the chosen landscape.
  • Analyze the data and identify key trends and threats.
  • Write a report summarizing your findings.
Build a Data Visualization Dashboard
Enhance your data analysis skills by building a data visualization dashboard using OSINT data.
Show steps
  • Choose a data visualization tool (e.g., Tableau, Power BI).
  • Gather OSINT data from various sources.
  • Clean and prepare the data for visualization.
  • Create visualizations to highlight key trends.
  • Design a dashboard to present your findings.

Career center

Learners who complete Basic Open Source Intelligence Analysis will develop knowledge and skills that may be useful to these careers:
Intelligence Analyst
The job of an intelligence analyst requires one to gather and analyze information to assess threats, trends, and risks. A course on Basic Open Source Intelligence Analysis helps build a foundation in the techniques and tools involved in gathering data from publicly available sources. As an intelligence analyst, you must master effective search techniques, and this course provides an overview of social media search tools. It directly addresses the role of open source intelligence in various fields, which helps prepare one for the diverse applications of an intelligence analyst, and to find, analyze, and understand intelligence effectively. Learning about real-time data collection may also be useful.
Security Analyst
A security analyst protects an organization's systems and data from cyber threats. Taking a course on Basic Open Source Intelligence Analysis aids in identifying and mitigating risks. Security analysts use many tools and techniques covered in this course daily. Those search techniques also help you to efficiently filter and analyze information which is critical because threats are constantly changing. This course may also prepare the security analyst to monitor and manage a wide range of threats, from physical to cybersecurity. The course material about ethical considerations will greatly help you. This helps allocate security resources efficiently based on intelligence.
Threat Intelligence Analyst
A threat intelligence analyst focuses on identifying, analyzing, and understanding potential cyber threats. A course on Basic Open Source Intelligence Analysis helps threat intelligence analysts by teaching them how to master effective search techniques with different types of tools and software. The course's teachings on critical thinking and analysis in using open source intelligence are invaluable. The course's focus on the latest use cases is directly applicable to the threat intelligence analyst's work. This may assist in developing robust defense mechanisms.
Cybersecurity Analyst
A cybersecurity analyst specializes in protecting digital assets from cyberattacks. This course on Basic Open Source Intelligence Analysis may be useful since cybersecurity analysts use open source intelligence to gather data on the latest threats, such as emerging malware or phishing campaigns, to defend organizations from the same. Learning about how to apply open source intelligence is valuable to understand adversaries' tactics. Being aware of legal considerations and ethical use of open source intelligence is also essential for the cybersecurity analyst. The course's coverage of search techniques, tools, and software provides a foundation for this role.
Information Security Analyst
An information security analyst is responsible for implementing security measures to protect an organization's sensitive information. If you are an information security analyst, this course on Basic Open Source Intelligence Analysis may be useful in understanding the fundamentals of open source intelligence and how to apply it. An information security analyst uses this for gaining competitive intelligence. This course may help you apply privacy and ethical considerations, which helps you maintain and improve your organization's reputation. The course's overview of search techniques, tools, and software lays a foundation for this role.
Counterterrorism Analyst
The counterterrorism analyst works to prevent terrorist attacks through gathering and assessing intelligence. A course on Basic Open Source Intelligence Analysis can help prepare an analyst for their duties. This may equip the analyst with effective search techniques to locate and analyze information effectively using open source intelligence. The course's focus on the importance of critical thinking and proper analysis gives context and nuance to raw information. The course's introduction to open source intelligence platforms, along with real-time data collection and ethical considerations, is incredibly valuable.
Competitive Intelligence Analyst
A competitive intelligence analyst helps companies understand their market position and the strategies of their competitors. A course on Basic Open Source Intelligence Analysis has much value. It may help you to develop critical analytical skills that are vital to success. One must also master effective search techniques to sift through large volumes of public data to find relevant information. The course's focus on analyzing information and the ethical considerations of open source intelligence are directly applicable to the job of a competitive intelligence analyst.
Fraud Investigator
A fraud investigator investigates allegations of fraud and gathers evidence for legal action. As a fraud investigator, this course may be helpful for analyzing information using open source intelligence and understanding potential avenues for investigation. This course can increase the capabilities of the fraud investigator by teaching them effective search techniques and providing an understanding of privacy and ethical considerations. This helps ensure that the fraud investigator is prepared to meet the requirements of the job.
Financial Analyst
A financial analyst evaluates financial data to make recommendations to businesses and individuals. A course on Basic Open Source Intelligence Analysis may be useful to the financial analyst, because it can enable them to understand the fundamentals of open source intelligence. The analyst may then apply this to understanding financial crimes such as fraud. This course can assist the analyst in applying privacy and ethical considerations in intelligence work. Search techniques are also valuable.
Market Research Analyst
A market research analyst studies market conditions to examine potential sales of a product or service. A course on Basic Open Source Intelligence Analysis may prove useful, because it familiarizes the analyst with open source intelligence, the application of privacy, and ethical considerations in open source intelligence. Market Research Analysts need effective search techniques, which are covered in this course. This course gives the analyst a foundation for identifying market trends, assessing competitive landscapes, and understanding consumer behavior through open source data. This course focuses on analyzing data for effective intelligence.
Journalist
The job of the journalist is to investigate and report on current events. A course on Basic Open Source Intelligence Analysis has some utility, as open source intelligence is an invaluable tool for journalists who must sift through vast amounts of data to uncover facts. The journalist may use the skills taught in this course to develop critical analytical skills, master effective search techniques, and adhere to the ethical considerations and constraints on open source intelligence work. Legal considerations are also covered in this course.
Policy Analyst
A policy analyst researches and analyzes policies and their impact on various sectors. Given the need to access and interpret diverse sources of information, this course on Basic Open Source Intelligence Analysis may be useful. The policy analyst may find it helpful in developing critical analytical skills, mastering effective search techniques, and thinking through the ethical and legal considerations that come with policy. The need to understand what is reliable is most useful.
Data Scientist
The role of a data scientist involves extracting knowledge and insights from data using various techniques and algorithms. While a data scientist often works with structured datasets, a background in open source intelligence can be surprisingly useful. A course on Basic Open Source Intelligence Analysis may help the data scientist in identifying relevant data sources, assessing the quality and reliability of information, and understanding the ethical implications of data collection and analysis. Although this course focuses on open source intelligence for security and intelligence analysts, concepts such as critical thinking and effective search strategies are directly transferable.
Research Assistant
A research assistant supports research projects by collecting data, conducting literature reviews, and assisting with analysis. A course on Basic Open Source Intelligence Analysis may be helpful to the research assistant. This may teach you about critical analysis, search techniques, and ethical considerations needed to conduct thorough and responsible research. Since this course is designed for security and intelligence analysts, it may not be fully applicable to all types of research.
Paralegal
A paralegal assists lawyers by conducting legal research, drafting documents, and gathering evidence. This course on Basic Open Source Intelligence Analysis has utility, but only limited utility, for the paralegal. The paralegal may find it beneficial in its focus on effective search techniques, open source intelligence, legal considerations, and ethical use. However, the course's focus on security and intelligence may not be relevant to the work of the paralegal.

Reading list

We've selected two books that we think will supplement your learning. Use these to develop background knowledge, enrich your coursework, and gain a deeper understanding of the topics covered in Basic Open Source Intelligence Analysis.
Comprehensive guide to OSINT techniques, tools, and methodologies. It provides practical advice on how to gather, analyze, and interpret open-source information. It is commonly used as a reference by industry professionals. This book adds depth to the course by providing real-world examples and case studies.
Explores the cognitive biases and psychological factors that can affect intelligence analysis. It provides strategies for mitigating these biases and improving analytical accuracy. This book is more valuable as additional reading than it is as a current reference. It adds breadth to the course by providing a deeper understanding of the human element in intelligence analysis.

Share

Help others find this course page by sharing it with your friends and followers:

Similar courses

Similar courses are unavailable at this time. Please try again later.
Our mission

OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.

Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.

Find this site helpful? Tell a friend about us.

Affiliate disclosure

We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.

Your purchases help us maintain our catalog and keep our servers humming without ads.

Thank you for supporting OpenCourser.

© 2016 - 2025 OpenCourser