BTCE | 5th Sem
DPDS SubjectUnit 2

DPDS Unit 2: Complete Concept Guide

Unit 2: Disaster Recovery and Fault Tolerance -> Generated and Prepared By Thiruselvan (ThiruXD)

TABLE OF CONTENT

PART 1: DISASTER RECOVERY FUNDAMENTALS

  • 1.1 Why Plan for the Worst?
    • Defining a Disaster
    • Types of Disasters
    • Critical Planning Principles
      • Correlated Failures
      • Failure of the Recovery Mechanism
      • The "Blast Radius"
    • The Recovery Paradox
  • 1.2 Business Continuity vs. Disaster Recovery
    • BCP vs DRP Comparison
    • Core Distinction
  • 1.3 Business Impact Analysis (BIA): The Planning Foundation
    • The Six-Step BIA Process
      • Scope Definition
      • Information Gathering
      • Critical-Function Identification
      • Impact Quantification
      • Recovery-Objective Definition
      • BIA Report
    • Impact Dimensions
      • Financial
      • Regulatory
      • Reputational

PART 2: RECOVERY METRICS AND TIERS

  • 2.1 Core Recovery Metrics
    • RTO (Recovery Time Objective)
    • RPO (Recovery Point Objective)
    • MTD (Maximum Tolerable Downtime)
    • WRT (Work Recovery Time)
    • The Fundamental Recovery Constraint (RTO + WRT ≤ MTD)
    • System Availability Formula
  • 2.2 Availability and Recovery Tiers
    • Tier 1: Mission-Critical Functions
    • Tier 2: Business-Critical Functions
    • Tier 3: Operational / Essential
    • Tier 4: Non-Critical / Support
  • 2.3 Recovery Strategies and DRP Lifecycle
    • DRP Lifecycle Phases
    • Recovery Site Types
      • Hot Site
      • Warm Site
      • Cold Site
      • Cloud / DRaaS
      • Reciprocal / Mobile
    • DRP Testing Ladder
      • Checklist
      • Tabletop
      • Parallel
      • Partial Interruption
      • Full Interruption
  • 2.4 Historical Case: Maersk NotPetya Recovery (2017)
    • Incident Overview
    • The "Ghana Miracle"
    • Recovery Timeline
    • Strategic Security Lessons

PART 3: BACKUP STRATEGIES

  • 3.1 The Strategic Balance
    • Key Strategic Decisions
      • Frequency
      • Retention
      • Media & Location
      • Security
    • Primary Drivers (RPO & RTO)
  • 3.2 Backup Types Compared
    • Full Backup
    • Incremental Backup
    • Differential Backup
    • Backup Schedule Strategies
      • Full + Daily Incremental
      • Full + Daily Differential
    • Comparison Table (Incremental vs Differential)
    • Continuous Data Protection (CDP) / Near-CDP
  • 3.3 The 3-2-1 and 3-2-1-1-0 Rules
    • The Classic 3-2-1 Rule
      • Three Copies of Data
      • Two Different Media Types
      • One Copy Off-site
    • The Modern 3-2-1-1-0 Rule
      • One Offline or Immutable Copy
      • Zero Unverified Errors
    • Strategic Resilience: Combating Ransomware
  • 3.4 Backup Media and Location Decisions
    • Storage Media Comparison
      • Magnetic Tape
      • HDD / SSD
      • Cloud Object
      • WORM / Optical
    • Location & Disaster Risk
      • On-Site
      • Vaulted Off-site
      • Cloud / DRaaS
      • Hybrid
    • Security Decision Guidelines
  • 3.5 Backup Verification Checklist
    • Continuous Job Monitoring
    • File-Level Restoration Sampling
    • Full-System Restoration Exercise
    • Cryptographic Integrity Checks
    • Automated Sandbox Verification
    • The Strategic Mandate
    • Recovery Success Criteria

PART 4: FAULT TOLERANCE

  • 4.1 Fault Tolerance vs High Availability vs Disaster Recovery
    • Comparison Framework
    • Failure Scope Hierarchy
  • 4.2 Redundancy Layers & Single Points of Failure
    • Power Redundancy
    • Hardware Redundancy
    • Network Redundancy
    • Software Redundancy
    • Data Redundancy
    • Geographic Redundancy
  • 4.3 RAID Building Blocks
    • Striping
    • Mirroring
    • Parity
    • RAID Is Not a Backup (Critical Distinction)
  • 4.4 RAID Levels
    • RAID 0: Striping
    • RAID 1: Mirroring
    • RAID 5: Distributed Parity
    • RAID 6: Dual Parity
    • RAID 10: 1+0 (Hybrid)
    • The Hot Spare Strategy
    • RAID 5 Risks
    • RAID 6 Advantages
  • 4.5 High-Availability Clustering
    • Active-Passive Model
    • Active-Active Model
    • The Failover Mechanism
      • Heartbeat Monitoring
      • Automatic Failover Process

PART 5: ANTI-MALWARE AND DETECTION

  • 5.1 Antivirus Software
    • Definition (Malware & Antivirus)
    • AV Core Objectives
      • Prevent
      • Detect
      • Quarantine
      • Remediate
    • Scanning Methods
      • On-Access Scanning
      • On-Demand Scanning
    • The Modern Shift (Legacy AV → EDR)
  • 5.2 Detection Methodologies
    • Detection Methodology Trade-offs
      • Signatures
      • Heuristics & Behavior
      • Sandboxing
    • Operational Best Practices
      • Automated Updates
      • Real-time Protection
      • Quarantine Management
      • Exclusion Audits
      • Full Scans
    • Critical Security Gaps
  • 5.3 Spyware Threat Profile
    • Types of Spyware
      • Keyloggers
      • Browser Hijackers & Adware
      • Credential Stealers
      • Remote Access Tools (RATs)
      • Mobile Surveillance
    • Infection Indicators
    • Detection Sources
      • Signatures & File Hashes
      • Persistence Monitoring
      • Process Behavior
      • Network Telemetry
      • Reputation Services
    • Safe Response & Removal
      • Isolate Endpoint
      • Preserve Evidence
      • Scan and Eradicate
      • Reset Credentials
      • Hardening

PART 6: SIGNATURE-BASED DETECTION

  • 6.1 What is a Malware Signature?
    • Core Definition
    • Six Typical Signature Forms
      • Exact Byte Sequence
      • Full-File Hash
      • String Pattern
      • YARA Rule
      • Generic Family Signature
      • Behavioral Sequence
    • Exact Identity vs Family vs Behaviour
    • Specificity Spectrum
  • 6.2 Creating and Using a Signature
    • The Signature Lifecycle
      • Collection
      • Refinement
      • Creation
      • Validation
      • Publication
      • Action
    • Operational Guidelines
    • Illustrative YARA Rule
  • 6.3 Why Typical Signatures Fail
    • Fundamental Weaknesses
      • Zero-Day Vulnerability
      • Hash Fragility
      • Obfuscation & Packing
    • Structural Code Evasion
      • Polymorphic Malware
      • Metamorphic Malware
      • Sandbox Awareness
    • Fileless & Memory-Only Threats
    • Strategic Shift

PART 7: CHECKSUMS AND ERROR DETECTION

  • 7.1 Simple Byte-Stream Checksum
    • Mechanics of Operation
    • Numerical Example: "Hi"
    • Inherent Weaknesses
      • Byte Reordering (Transposition)
      • Collision Susceptibility
      • Vulnerability to Forgery
    • Key Takeaway
  • 7.2 CRC: Cyclic Redundancy Check
    • How CRC Works
    • Common Applications
    • The Security Boundary (Accidental vs Adversarial)
  • 7.3 Custom Checksums
    • Design Requirements
    • Common Algorithmic Options
      • Simple Sum
      • Adler-32
      • Fletcher-32
      • CRC-32
    • Position-Weighted Schemes
    • Critical Limitation
    • The Golden Selection Rule
    • Verification Checklist

PART 8: CRYPTOGRAPHIC HASHES

  • 8.1 Cryptographic Hash Fundamentals
    • Core Properties
      • Deterministic
      • Fixed Output Length
      • Pre-image Resistance
      • 2nd Pre-image Resistance
      • Collision Resistance
      • Avalanche Effect
  • 8.2 Major Hash Algorithms Compared
    • MD5
    • SHA-1
    • SHA-256
    • SHA-3
    • BLAKE2
    • Critical Implementation Rule
  • 8.3 Why MD5 and SHA-1 Are Broken
    • The Core Threat: Collision Attacks
    • MD5 (128-bit)
      • Rogue CA Certificate (2008)
    • SHA-1 (160-bit)
      • SHAttered Attack (2017)
    • Security Mandate: Immediate Migration Required
  • 8.4 Hashes in File Integrity and Malware Detection
    • File Integrity & Baselines
      • Establishing Trust
      • Secure Storage
      • Verification Cycle
      • FIM Alerts
    • Malware Identification
      • Indicators of Compromise (IoC)
      • Fast Lookups
      • The "Brittleness" Problem
      • Polymorphism
    • Strategic Shift
  • 8.5 Digital Signatures
    • The Signing Mechanism
      • Generate Digest
      • Encrypt Digest
      • Distribute Package
    • The Verification Mechanism
      • Decrypt Signature
      • Independent Re-hash
      • Comparative Check
    • Functions of Digital Signatures
      • Integrity
      • Authentication
      • Non-repudiation

PART 9: ADVANCED SIGNATURES

  • 9.1 Advanced Malware Signatures
    • Key Distinction (Digital Signature vs Malware Signature)
  • 9.2 Fuzzy Hashing
    • Why Fuzzy Hashing?
      • Limitations of Cryptographic Hashes
      • The Detection Gap
    • The Fuzzy Hashing Solution
      • Context-Triggered Piecewise Hashing (CTPH)
      • Features: Comparable Signatures, Variant Detection, Robustness, Similarity Scoring
  • 9.3 SSDEEP Algorithm
    • Process Flow
      • Block Size Selection
      • Rolling Hash & Trigger Boundaries
      • Piecewise Hashing
      • Dual-Signature Generation
      • Edit Distance Comparison
  • 9.4 Fuzzy Hash Use Cases and Alternatives
    • Algorithm Comparison
      • SSDEEP
      • TLSH
      • SDHash
      • LZJD
    • Key Use Cases
      • Variant Detection
      • Malware Clustering
      • Phishing Similarity
      • Code Attribution
      • Incident Triage
    • Key Teaching Point
  • 9.5 CFG Hashing and Import Hashing
    • Control Flow Graph (CFG) Hashing
      • Structural Analysis
      • Resilience
      • Clustering
      • BinDiff Integration
    • Import Hashing (ImpHash)
      • API Profile
      • Efficiency
      • Fingerprinting
      • Limitation

PART 10: TECHNIQUE SELECTION MATRIX

  • Selecting the Optimal Integrity and Recovery Technique
    • Detecting Accidental Data Corruption
    • Verifying Exact File Integrity
    • Ensuring Message Integrity with Authentication
    • Verifying File Origin, Integrity, and Non-repudiation
    • Identifying Structurally Similar Malware Variants
    • Analyzing Binary Code Structure
    • Grouping Malware by API Profiles
    • Maintaining Continuous Service and Availability

PART 11: KEY TAKEAWAYS

  • Key Takeaways
    • Disaster Recovery
    • Fault Tolerance
    • Detection Techniques

PART 1: DISASTER RECOVERY FUNDAMENTALS

1.1 Why Plan for the Worst?

Defining a Disaster

Disaster: Any event that causes a disruption beyond normal operating procedures, requiring extraordinary measures to restore stability and service.

Types of Disasters

CategoryExamples
NaturalEarthquakes, floods, storms, wildfires
Cyber/HumanRansomware, sabotage, human error
TechnicalPower grid failure, hardware crashes
Supply ChainThird-party vendor or logistics failure
HealthPandemics, mass workforce absence

Critical Planning Principles

PrincipleDescription
Correlated FailuresPlanning must account for events that trigger secondary failures (e.g., a flood causing a power outage)
Failure of the Recovery MechanismWhat happens if the backup systems or the DRP itself fails during the incident?
The “Blast Radius”Understanding the geographic and operational span of a single event

The Recovery Paradox

Key Insight: A recovery plan is only a “plan” until it is tested. An untested recovery mechanism is often the first thing to fail when a real disaster strikes.

Resilience requires planning for the failure of your backup plan.


1.2 Business Continuity vs. Disaster Recovery

DRP is a technical subset of the broader BCP framework.

FeatureBusiness Continuity (BCP)Disaster Recovery (DRP)
ScopeOrganization-wide; business processes and peopleIT systems, data, networks, and infrastructure
GoalContinuous operations and organizational resilienceRestoration of technical assets after a disaster
TimingProactive and ongoing during disruptionReactive; initiated post-disruption
OwnershipExecutive Leadership & Business Unit HeadsIT Management, CIO, & Technical Teams
OutputCrisis management & relocation plansTechnical runbooks & data restore procedures

Core Distinction: BCP asks “How do we keep the doors open?”, while DRP asks “How do we get the servers back online?”


1.3 Business Impact Analysis (BIA): The Planning Foundation

The Six-Step BIA Process

StepDescription
01 Scope DefinitionEstablish boundaries and prioritize specific organizational units
02 Information GatheringCollect data via surveys, interviews, and automated discovery
03 Critical-Function IdentificationDistinguish essential operations from supportive tasks
04 Impact QuantificationAssign monetary and non-monetary values to potential losses
05 Recovery-Objective DefinitionSet specific time and data loss targets (RTO/RPO)
06 BIA ReportFormalize findings to guide executive recovery strategy decisions

Impact Dimensions

DimensionDescription
FinancialLost revenue, idle labor costs, and contractual penalties
RegulatoryLegal fines, compliance breaches, and litigation risk
ReputationalLong-term brand damage and market value decline

Key Teaching Message: Without a rigorous BIA foundation, all subsequent recovery decisions (RTO/RPO) become mere guesswork and lack strategic alignment.


PART 2: RECOVERY METRICS AND TIERS

2.1 Core Recovery Metrics

MetricDefinitionQuestion It Answers
RTO (Recovery Time Objective)Maximum acceptable duration of an outage“How quickly must we recover?”
RPO (Recovery Point Objective)Maximum acceptable data loss (measured in time)“How much data can we afford to lose?”
MTD (Maximum Tolerable Downtime)Absolute limit before irreversible harm occurs“What’s the breaking point?”
WRT (Work Recovery Time)Time needed to validate data and resume normal ops“How long to get back to full capacity?”

The Fundamental Recovery Constraint

RTO + WRT ≤ MTD

System Availability Formula

Availability = MTBF / (MTBF + MTTR)

Where:

  • MTBF: Mean Time Between Failures
  • MTTR: Mean Time To Repair

2.2 Availability and Recovery Tiers

Criticality Drives Architecture: As RTO and RPO objectives tighten, the complexity and cost of the recovery solution increase exponentially. Tier classification ensures resources are allocated to the most vital business functions.

Recovery TierClassificationRTO (Target)RPO (Target)
Tier 1Mission-Critical Functions< 1 HourNear-Zero / Minutes
Tier 2Business-Critical Functions4 – 8 Hours1 – 4 Hours
Tier 3Operational / Essential24 – 48 HoursUp to 24 Hours
Tier 4Non-Critical / Support72+ HoursVaries (Days)

Note: Tier 0 typically represents continuous availability (Fault Tolerance).


2.3 Recovery Strategies and DRP Lifecycle

DRP Lifecycle Phases

  1. Initiate → 2. BIA → 3. Select Strategy → 4. Develop Plan → 5. Implement → 6. Test → 7. Maintain

Recovery Site Types

Site TypeCharacteristics & ReadinessRelative Cost
Hot SiteFully configured; mirrored data; ready in minutes/hoursHighest
Warm SiteEquipped with hardware; requires data restorationMedium
Cold SiteShell space; power/cooling only; long setup timeLowest
Cloud / DRaaSVirtualized; flexible; pay-per-use; high scalabilityVariable
Reciprocal / MobileMutual aid agreements or trailer-based mobile unitsLow-Medium

DRP Testing Ladder

Test TypeDescription
ChecklistHigh-level review of plan components
TabletopRole-play scenario in a meeting room
ParallelSystems run at DR site without interruption
Partial InterruptionTest critical systems only
Full InterruptionEntire site cutover (highest risk)

2.4 Historical Case: Maersk NotPetya Recovery (2017)

Incident Overview

  • Impact: USD 300 Million Revenue Impact
  • Cause: NotPetya ransomware propagated globally, encrypting entire Active Directory (AD) infrastructure in minutes

The “Ghana Miracle”

“The only reason we were able to recover was because of a power cut in Ghana. That domain controller was the only surviving copy of our Active Directory data.”

Recovery Timeline:

  1. IT found a single surviving domain controller in Ghana
  2. Saved by a timely local power outage that kept it offline
  3. Hard drive flown from Lagos to London
  4. Served as the master seed for global network reconstruction

Strategic Security Lessons

LessonApplication
Offline AD BackupsKeep immutable, air-gapped copies of critical identity infrastructure
Network SegmentationPrevent lateral movement of malware across global geographic sites
Geographic IsolationValidate that “global” systems have localized resilience points
Supply Chain VigilanceNotPetya entered via a compromised software update (M.E.Doc)

PART 3: BACKUP STRATEGIES

3.1 The Strategic Balance

Definition: A backup is a separate, independent copy of data that enables restoration following loss, corruption, or destruction. It is the final safety net for business continuity.

Key Strategic Decisions

Decision AreaConsiderations
FrequencyHow often snapshots are taken (Hourly vs. Daily)
RetentionHow long historical versions are kept (Compliance)
Media & LocationCloud, Tape, or Disk; On-site vs. Off-site
SecurityEncryption at rest and in transit; Access control

Primary Drivers

  • RPO → Determines Frequency: “How much data can we afford to lose?” (e.g., 1 hour of transactions)
  • RTO → Determines Restore Speed: “How quickly must we be back online?” (e.g., 4 hours)

3.2 Backup Types Compared

Backup TypeDescriptionBackup SpeedRestore SpeedStorage Usage
Full BackupCopies all selected dataSlowestFastest (single source)Highest
Incremental BackupCopies changes since any previous backupFastestSlowest (must process every incremental)Lowest
Differential BackupCopies changes since last Full backupModerateFast (Full + 1 Differential)Higher

Backup Schedule Strategies

Full + Daily Incremental

  • Sunday: Full Backup of all selected data
  • Daily: Captures changes since any previous backup
  • Pros: Fastest backup window; minimal storage growth
  • Cons: Requires complex “chain” of all files for restoration

Full + Daily Differential

  • Sunday: Full Backup of all selected data
  • Daily: Captures changes since last Full backup
  • Pros: Only two components needed for any restoration
  • Cons: Daily backup size grows as the week progresses

Comparison Table

MetricIncremental StrategyDifferential Strategy
Backup SpeedVery Fast (smallest daily delta)Moderate (grows daily)
Restore SpeedSlowest (must process every incremental)Fast (Full + 1 Differential)
Storage UsageLowest (no redundancy between backups)Higher (redundant data in daily diffs)

Continuous Data Protection (CDP) / Near-CDP

  • Supports minute or second-level RPO
  • Captures every data change/snapshot
  • Ideal for mission-critical databases where data loss must be near-zero

3.3 The 3-2-1 and 3-2-1-1-0 Rules

The Classic 3-2-1 Rule

Rule ComponentDescription
3 Copies of DataKeep at least one primary copy and two additional backups to mitigate the risk of a single point of failure
2 Different Media TypesStore backups on different technologies (e.g., Disk + Tape, or NAS + Cloud) to avoid correlated hardware failures
1 Copy Off-siteGeographic separation protects against site-wide disasters like fire, flood, or regional power outages

The Modern 3-2-1-1-0 Rule

ExtensionDescription
1 Offline or Immutable CopyMaintain an Air-Gapped or WORM (Write Once, Read Many) copy that ransomware cannot encrypt or delete
0 Unverified ErrorsAutomated recovery verification. A backup is not a backup until it has been successfully restored and validated

Strategic Resilience: Combating Ransomware

Modern backup architecture must prioritize immutability. Air-gapped backups (physically disconnected) or logical WORM storage ensure that even if administrative credentials are compromised, the historical data remains untouchable. Verification (the “0” in 3-2-1-1-0) ensures the restore path is functional within RTO constraints.


3.4 Backup Media and Location Decisions

Storage Media Comparison

Media TypeKey CharacteristicsRestore Speed
Magnetic TapeLow cost/GB, high capacity, offline storage (air-gap). Best for retentionVery Slow
HDD / SSDDirect access, NAS/SAN integration. Vulnerable to ransomware if onlineVery Fast
Cloud ObjectInfinite scalability, managed by 3rd party. Off-site by designModerate
WORM / OpticalWrite-Once-Read-Many. Immutable data protection. High durabilitySlow

Location & Disaster Risk

LocationPrimary BenefitsSite Disaster Protection
On-SiteLAN speed restoration, immediate physical access. No bandwidth costZero Protection
Vaulted Off-sitePhysical isolation from regional disasters. High securityHigh Protection
Cloud / DRaaSGeographic diversity, accessible from any internet connectionHigh Protection
HybridLocal cache for speed + Cloud sync for geographic safetyBalanced

Security Decision: Select Media based on RTO/RPO and Cost; Select Location based on Site Disaster Risk and Ransomware Reachability. Always maintain one offline (air-gapped) copy to ensure recovery from destructive cyber-attacks.


3.5 Backup Verification Checklist

Checklist ItemDescription
Continuous Job MonitoringReview logs daily for partial failures, skipped files, or timeout errors
File-Level Restoration SamplingPerform random restore tests of individual files to ensure media readability
Full-System Restoration ExerciseValidate the entire restore chain (Full + Differentials/Incremental)
Cryptographic Integrity ChecksCalculate SHA-256 at write and verify at restore to detect bit-rot or tampering
Automated Sandbox VerificationUse isolated VMs to automatically boot and verify recovery environments

The Strategic Mandate

“A backup is only valid if it restores within the required RTO and meets the required RPO.”

Recovery Success Criteria

Measured Restore Time ≤ RTO

Warning: An untested DRP is a liability, not a protection. Restoration speed is often bottlenecked by bandwidth, decryption, or media latency.


PART 4: FAULT TOLERANCE

4.1 Fault Tolerance vs High Availability vs Disaster Recovery

Comparison Framework

AspectFault ToleranceHigh AvailabilityDisaster Recovery
Primary ObjectiveZero downtime and continuous serviceMinimized downtime and uptime maximizationRestoration of service after site loss
MechanismHardware redundancy; duplicate components operating in parallelClustering, load balancing, and automated failover to standbyOff-site backups, secondary data centers, and DRP runbooks
Scope of LossZero data loss; zero interruption during failureBrief interruption; minimal/negligible data lossAcceptable downtime (RTO) and data loss (RPO)
CharacteristicsHighest cost and complexity; handles component failures transparentlyFocuses on service continuity despite system software or server failuresThe final safety net; involves manual or scripted site-level rebuilding

Failure Scope Hierarchy

  1. Component-Level Failure → Fault Tolerance
  2. System/Service Interruption → High Availability
  3. Site-Wide Catastrophe → Disaster Recovery

4.2 Redundancy Layers & Single Points of Failure

Power Redundancy

  • Uninterruptible Power Supplies (UPS)
  • Backup Diesel Generators
  • Dual Power Distribution Units (PDUs)
  • Redundant Utility Grid Feeds

Hardware Redundancy

  • Redundant Power Supplies (PSUs)
  • NIC Teaming / Link Aggregation
  • ECC Memory & Hot-spare CPU
  • RAID Storage (Local Resilience)

Network Redundancy

  • Dual ISPs (Diverse Path Routing)
  • Redundant Core Switches & Routers
  • BGP Multi-homing
  • Load Balancers (Traffic Distribution)

Software Redundancy

  • Active-Passive/Active-Active Clusters
  • Microservices / Containers
  • Application Failover Logic
  • Health Check Heartbeats

Data Redundancy

  • Database Replication (Async/Sync)
  • Distributed File Systems
  • Cloud Object Versioning
  • Continuous Data Protection (CDP)

Geographic Redundancy

  • Multi-Region Deployment
  • Cloud Availability Zones (AZ)
  • Off-site Disaster Recovery Centers
  • Global Load Balancing (GSLB)

4.3 RAID Building Blocks

RAID Concepts

ConceptDescriptionCharacteristics
StripingSplits data into “stripes” or chunks across multiple physical disksIncreases I/O performance. Allows parallel read/writes. Increases capacity utilization. Provides zero redundancy
MirroringSimultaneously writes the exact same data to two or more disksFull data duplication. Highest fault tolerance. Shortest recovery time. 50% storage overhead
ParityCalculates binary logic (XOR) to store mathematical checksumsReconstructs lost data. Balances capacity and safety. Efficient space utilization. Write performance penalty

RAID Is Not a Backup

CRUCIAL DISTINCTION: RAID IS NOT A BACKUP

RAID protects against physical hardware (disk) failure, but it does NOT provide data protection for other threats.

RAID offers zero protection against:

  • File deletion (deletion is instantly mirrored)
  • Corruption (corruption is instantly mirrored)
  • Ransomware (encryption is instantly mirrored)
  • Human error (mistakes are instantly mirrored)
  • Site-wide disasters (fire, flood, theft)

Teaching Point: If you delete a file on a RAID 1 (Mirror), the deletion is instantly “mirrored” to the other disk. The data is gone.


4.4 RAID Levels

RAID Level Comparison

RAID LevelDescriptionMin DrivesFault TolerancePerformanceBest Use Case
RAID 0Striping20 (Zero)Max Read/WriteTemporary files, non-critical data
RAID 1Mirroring21 DriveHigh Read, Normal WriteCritical data with simple redundancy
RAID 5Distributed Parity31 DriveGood Read, Moderate WriteStandard storage/file servers
RAID 6Dual Parity42 DrivesSlower writes than RAID 5Large drives; survives failure during rebuild
RAID 101+0 (Hybrid)41 per mirror pairPeak IOPS/Low latencyDatabases and high-load apps

The Hot Spare Strategy

An idle, powered-on drive ready to automatically replace a failed disk, initiating an immediate background rebuild to minimize the window of vulnerability.

RAID 5 Risks

  • Long rebuild times on large drives
  • Risk of second failure during rebuild
  • Performance degradation during rebuild

RAID 6 Advantages

  • Survives 2 drive failures
  • Crucial for large capacity drives
  • Protects during rebuild operations
  • Added parity write penalty

4.5 High-Availability Clustering

Active-Passive Model

FeatureDescription
OperationCold/Warm Standby: Secondary node remains idle until the primary fails
ManagementSimple: No complex state synchronization required for concurrent traffic
UtilizationLower: 50% of hardware resources are typically dormant
Failover TimeService pause while standby node takes over resources

Active-Active Model

FeatureDescription
OperationLoad Distribution: All nodes actively serve requests simultaneously
ThroughputHigh: Maximizes hardware utilization and capacity
ComplexityRequires robust session state sharing and locking
ResilienceSurviving nodes absorb the load of the failed component

The Failover Mechanism

Heartbeat Monitoring:

  • A dedicated network link or “keep-alive” signal between nodes
  • If the heartbeat is lost, the cluster initiates a failure detection protocol

Automatic Failover Process:

  1. Detect Failure
  2. Verify (Quorum)
  3. Reassign IP/Services
  4. Update Load Balancer
  5. Restore Traffic

PART 5: ANTI-MALWARE AND DETECTION

5.1 Antivirus Software

Definition

  • Malware: Malicious software designed to infiltrate, damage, or disrupt computer systems
  • Antivirus (AV) : A software suite designed to prevent, detect, and remediate malicious files and processes

AV Core Objectives

ObjectiveDescription
PreventBlock malicious code before execution (Email/Web)
DetectIdentify existing infections through scanning
QuarantineIsolate suspicious files in a secure container
RemediateDisinfect files or remove the malware entirely

Scanning Methods

MethodDescription
On-Access ScanningReal-time protection. Scans files as they are opened, copied, or executed. Monitors active system processes. Intercepts downloads and email attachments
On-Demand ScanningUser-initiated or scheduled deep scans of the filesystem. Full system scans (thorough but resource intensive). Specific directory/removable media scans

The Modern Shift

Transition from Legacy AV (Signature-heavy) to EDR (Endpoint Detection and Response), emphasizing behavioral monitoring and active response telemetry.


5.2 Detection Methodologies

Detection Methodology Trade-offs

MethodStrengthsLimitations
Signatures• Extremely fast execution• High precision (low false positives)• Definitive identification of known threats• Blind to “Zero-Day” attacks• Defeated by minor code changes• Requires frequent database updates
Heuristics & Behavior• Detects unknown variants• Identifies “Zero-Day” patterns• Monitors real-time process actions• High False Positive rate• Significant performance overhead• Risk of blocking legitimate software
Sandboxing• Safely executes suspicious files• Deep visibility into malware intent• Slow (latency in execution)• “Sandbox-aware” malware remains dormant

Operational Best Practices

PracticeDescription
Automated UpdatesMaintain real-time signature and engine parity
Real-time ProtectionEnable on-access scanning for all I/O operations
Quarantine ManagementRegular review of isolated files to minimize data loss
Exclusion AuditsStrictly control and audit scan exclusion lists
Full ScansSchedule periodic deep scans for dormant threats

Critical Security Gaps

Traditional AV often fails against Fileless Malware (living-off-the-land) and Encrypted Payloads. Modern protection requires memory, registry, and network traffic monitoring.


5.3 Spyware Threat Profile

Types of Spyware

TypeDescription
KeyloggersCovertly records every keystroke to exfiltrate passwords, credit card numbers, and confidential messages
Browser Hijackers & AdwareModifies browser settings (homepages, search engines) and injects unwanted advertisements or redirects
Credential StealersTargets specific sensitive data such as banking credentials, cryptocurrency private keys, and session cookies
Remote Access Tools (RATs)Provides administrative control to an attacker, allowing for file manipulation, webcam access, and software execution
Mobile SurveillanceSpecialized spyware for tracking GPS locations, recording calls, and monitoring private messaging apps

Infection Indicators

Indicator
Unexpected browser extensions, toolbars, or frequent redirects
Unusual outbound network connections to unknown IP addresses
Sudden system sluggishness or unexplained high CPU usage
Unauthorized account access or strange security alerts
Webcam indicators lighting up without user alerts

Takeaway: Spyware operates covertly; detection relies on behavioral monitoring and persistence checks.

Detection Sources

SourceDescription
Signatures & File HashesMatching unique byte sequences and SHA-256 digests of known spyware variants
Persistence MonitoringChecking Registry keys, Start-up entries, and unexpected browser extensions
Process BehaviorDetecting API hooking, keyloggers, and covert screen-scraping activity
Network TelemetryIdentifying unusual outbound connections to known C2 (Command & Control) servers
Reputation ServicesCloud-based lookups for file, URL, and certificate trustworthiness

Safe Response & Removal

StepAction
Isolate EndpointDisconnect from network to stop data exfiltration
Preserve EvidenceCapture memory dumps or disk images before cleanup for forensic analysis
Scan and EradicateUse offline scanners to remove/quarantine malicious files and registry entries
Reset CredentialsChange all passwords from a clean device, as current ones may be compromised
HardeningPatch vulnerabilities, review extensions, and monitor for reinfection

Critical Warning: Never reset passwords on the infected machine; spyware may still be logging keystrokes during the process.


PART 6: SIGNATURE-BASED DETECTION

6.1 What is a Malware Signature?

Core Definition: A malware signature is a unique byte sequence or pattern that reliably identifies a known malicious file or code. It acts as a fingerprint: the detection engine compares a candidate file against a database of known signatures and flags any match.

Six Typical Signature Forms

TypeDescriptionExample
Exact Byte SequenceFixed hex pattern at a known offset; fast but brittle — one byte change defeats it4D 5A 90 00 E8 ?? ?? 00 00
Full-File HashCryptographic digest of entire file; exact identity, zero tolerance for any modificationSHA-256: a3f2...c91b
String PatternHardcoded command strings, registry keys, or URLs embedded in malware code"cmd.exe /c del %temp%\\*"
YARA RuleCombines multiple strings/byte patterns with Boolean logic for flexible, expressive matchingrule Malware { strings: $s = "evil" condition: $s }
Generic Family SignatureWildcard or partial pattern covering shared structural code across a malware familyTrojan.GenericKD.*
Behavioral SequenceOrdered API/system-call sequence; identity defined by actions, not bytesCreateProcess → WriteFile → RegSetValue

Exact Identity vs. Family / Behaviour

TypeDescription
Exact IdentityFull-file hash (MD5/SHA-256) or precise byte sequence — matches one specific sample only
Family MatchGeneric/wildcard pattern covering shared code across a malware family, surviving minor mutations
Behaviour MatchOrdered API/system-call sequence — identifies what the code does, independent of byte content

Specificity Spectrum

Exact (Hash) ←→ Broad (Behaviour)

Exact signatures offer precision; generic and behavioural signatures extend coverage to variants and zero-day-adjacent threats.


6.2 Creating and Using a Signature

The Signature Lifecycle

StepDescription
1. CollectionGather diverse malware samples and identify stable, distinctive binary code or data segments
2. RefinementExclude common benign content (Standard libraries, OS APIs) to prevent false positive detections
3. CreationDevelop patterns using hex byte sequences, string matches, or logic-based YARA rules
4. ValidationTest the rule against massive corpora of both malicious and clean files to ensure accuracy
5. PublicationDistribute verified signatures to endpoints and scanning engines via secure update channels
6. ActionScan files or memory; trigger automated responses: Alert, Quarantine, or Remediate

Operational Guidelines

  • Identify code that remains unchanged across different versions of a malware family
  • Use wildcards (??) to account for variable data or addresses in the byte stream
  • Balance precision (avoiding FPs) with breadth (detecting variants)

Note: A signature is only as effective as its last update; real-time protection relies on frequent, automated signature feed ingestion.

Illustrative YARA Rule

rule Malware_Family_Alpha
{
    strings:
        $a = { 4D 5A 90 00 ?? ?? 00 00 }
        $b = "malicious_payload"
    condition:
        $a and $b
}

6.3 Why Typical Signatures Fail

Fundamental Weaknesses

WeaknessDescription
Zero-Day VulnerabilityNo signature exists for unknown threats; protection is absent until a sample is analyzed and the database updated
Hash FragilityExact cryptographic hashes (MD5/SHA-256) are defeated by single-byte changes, creating an entirely new digest
Obfuscation & PackingCompressors and “crypters” hide the actual malicious code, presenting only a benign-looking stub to the scanner

Structural Code Evasion

TechniqueDescription
Polymorphic MalwareUses a mutation engine to change its decryption routine while keeping the payload encrypted, breaking static patterns
Metamorphic MalwareRewrites its own code logic entirely (instruction substitution, dead-code insertion) to change structural signatures
Sandbox AwarenessDetection fails if the malware remains dormant when it senses a virtualized environment or analysis debugger

Fileless & Memory-Only Threats

Traditional scanners look for files on the disk. Fileless malware resides only in RAM or leverages legitimate system tools (PowerShell, WMI) to execute malicious commands. Since there is no “malicious file” to hash or scan for byte patterns, typical signatures are completely bypassed.

Strategic Shift: Because exact signatures are brittle, modern defense must evolve toward Generic Signatures, Heuristics, Behavioral Analysis, and Fuzzy Hashing to detect variants and structural similarities.


PART 7: CHECKSUMS AND ERROR DETECTION

7.1 Simple Byte-Stream Checksum

Mechanics of Operation

A fundamental error-detection technique that treats data as a stream of numeric values (bytes). It is primarily used to detect accidental data corruption during transmission or storage.

Checksum = (Sum of Bytes) mod 256

Process:

  1. Summation: Add the numeric value of each byte in the message
  2. Modulo: Reduce the total sum modulo 256 (for 8-bit)
  3. Verification: Receiver recomputes and compares with the appended value

Numerical Example: “Hi”

CharacterHexadecimalDecimal Value
‘H’0x4872
‘i’0x69105
Total Sum0xB1177

Result: The checksum 177 (0xB1) is appended to the message “Hi”.

Inherent Weaknesses

WeaknessDescription
Byte Reordering (Transposition)Because addition is commutative, “Hi” (72+105) and “iH” (105+72) both result in 177. The checksum fails to detect sequence errors
Collision SusceptibilityWith only 256 possible values (8-bit), different data streams frequently yield the same sum, leading to undetected errors
Vulnerability to ForgeryAn attacker can easily modify data and adjust subsequent bytes to maintain the same total sum, making it useless for security

Key Takeaway

Simple byte-stream checksums are suitable for low-level hardware error detection where computational resources are extremely limited, but they offer zero protection against intentional adversarial modification.


7.2 CRC: Cyclic Redundancy Check

Definition: A mathematical algorithm used to detect accidental changes to raw data.

How CRC Works

  • Polynomial Representation: Data bits are treated as coefficients of a polynomial over the Galois Field GF(2)
  • Process: The message polynomial is divided by a fixed Generator Polynomial
  • Result: The remainder is the CRC value

Common Applications

ApplicationCRC Variant
NetworkingEthernet (CRC-32), Wi-Fi (FCS) to detect transmission noise
StorageHDD/SSD internal consistency checks
File FormatsZIP, GZIP, and PNG use CRC-32 to ensure file integrity during decompression

The Security Boundary

Accidental Error Detection ≠ Adversarial Security

CRC is linear and non-cryptographic. An attacker can modify a message and easily recompute a valid CRC to match the forgery. Never use CRC for security or anti-tamper purposes.


7.3 Custom Checksums

Design Requirements

RequirementDescription
Message ProfileDefine typical/maximum message size and required output width (8, 16, 32-bit)
Error ModelIdentify expected failures (single-bit, burst errors, or byte transpositions)
Computation LimitsFactor in CPU/hardware constraints and real-time processing needs
Implementation DetailsSpecify endianness, modulo handling, and initial/final XOR values
InteroperabilityEnsure consistent versioning across different system architectures

Common Algorithmic Options

AlgorithmMechanismStrengthBest Use Case
Simple SumModular AdditionPOORLegacy systems; very small data chunks where speed is critical
Adler-32Dual Running SumsLOWZlib/Gzip; faster than CRC but weaker on short messages
Fletcher-32Dual Modulo SumsMODERATEEmbedded systems; improved detection of transpositions
CRC-32Polynomial DivisionHIGHNetwork (Ethernet), Storage (ZIP, PNG); robust accidental error detection

Position-Weighted Schemes

  • Assigns weights based on byte index to detect transpositions (e.g., “AB” vs “BA”)
  • Essential for simple modular sums where order sensitivity is required

Critical Limitation

Custom checksums are designed for Error Detection only. They provide NO protection against intentional, adversarial modification.

The Golden Selection Rule

RequirementRecommended Technique
Accidental Corruption?Use Standard CRC or Checksum
Adversarial Integrity?Use SHA-256, HMAC, or Signatures

Security Warning: Never use a standard checksum to defend against intentional tampering.

Verification Checklist

  • Test against known test vectors
  • Verify single-bit error detection
  • Test burst-error resilience
  • Check transposition & truncation
  • Validate platform compatibility

PART 8: CRYPTOGRAPHIC HASHES

8.1 Cryptographic Hash Fundamentals

A cryptographic hash function maps an arbitrary-sized input (message) to a fixed-length bit string (digest or fingerprint). It is a fundamental building block for data integrity and malware identification.

Core Properties

PropertyDescription
DeterministicThe same input message will always produce the exact same hash digest
Fixed Output LengthRegardless of input size (1KB or 1TB), the output length remains constant (e.g., 256 bits)
Pre-image Resistance“One-Way” property: Computationally infeasible to find input x given hash value h(x)
2nd Pre-image ResistanceInfeasible to find a second input y that has the same hash as a specific input x
Collision ResistanceInfeasible to find any two different inputs x and y such that h(x) = h(y)
Avalanche EffectChanging a single bit in the input results in a massive, unpredictable change in the output

8.2 Major Hash Algorithms Compared

AlgorithmOutput BitsSecurity StatusPerformanceRecommended Use Case
MD5128 bitsBrokenVery FastNon-security tasks; legacy file checksums where collision risk is acceptable
SHA-1160 bitsBrokenFastLegacy systems only; deprecated for digital signatures and SSL/TLS certificates
SHA-256256 bitsSecureModerateCurrent industry standard for file integrity, digital signatures, and blockchain
SHA-3224–512 bitsSecureModerateModern sponge-based design; high-security alternative if SHA-2 is compromised
BLAKE2Up to 512 bitsSecureVery FastHigh-performance applications requiring cryptographic strength with low overhead

Critical Implementation Rule: Avoid MD5 and SHA-1 for all new security designs. Migration to SHA-256 or SHA-3 is mandatory for collision resistance and long-term data integrity.


8.3 Why MD5 and SHA-1 Are Broken

The Core Threat: Collision Attacks

A collision occurs when two different inputs produce the exact same hash digest. This violates the 1:1 mapping principle, allowing attackers to substitute legitimate files with malicious ones without changing the resulting signature.

MD5 (128-bit)

AspectDetail
StatusCryptographically broken since 2004
VulnerabilityCollisions can now be generated in seconds on standard consumer hardware
ImpactUndermines file integrity baselines and digital certificates

Rogue CA Certificate (2008): Researchers successfully leveraged MD5 collisions to create a rogue Certificate Authority that was trusted by all major browsers.

SHA-1 (160-bit)

AspectDetail
StatusDeprecated for secure uses since 2017
VulnerabilityTheoretical attacks proven practical via massive computational effort (Google/CWI)
ImpactCollision attacks undermine code signing and document integrity

SHAttered Attack (2017): First practical SHA-1 collision: two PDF files with different content (one benign, one malicious) shared the same hash.

Security Mandate: Immediate Migration Required

Cease use of MD5 and SHA-1 for digital signatures, certificates, and integrity checks. Migrate to SHA-256 (SHA-2) or SHA-3 for all adversarial security contexts.


8.4 Hashes in File Integrity and Malware Detection

File Integrity & Baselines

StepDescription
Establishing TrustCalculate SHA-256 digests for all “known good” system and application files
Secure StorageStore baseline hashes in a read-only or offline repository to prevent tampering
Verification CycleRe-calculate hashes during file transfers, system restores, or scheduled audits
FIM AlertsTrigger immediate alerts if a file’s current hash deviates from its baseline

Key Goal: Detect unauthorized modifications by attackers or accidental corruption during data movement.

Malware Identification

MethodDescription
Indicators of Compromise (IoC)Exact hashes (SHA-256) serve as high-fidelity signatures for known malware
Fast LookupsCompare unknown file hashes against global threat intelligence databases (e.g., VirusTotal)
The “Brittleness” ProblemChanging a single byte in a malware file results in a completely different hash
PolymorphismModern threats use automated changes to evade hash-based detection easily

Strategic Shift: Exact hashes provide “Identity”; Fuzzy/Structural hashes provide “Similarity.”


8.5 Digital Signatures

The Signing Mechanism

StepDescription
1. Generate DigestSender hashes the document using a cryptographic algorithm (e.g., SHA-256) to create a fixed-length digest
2. Encrypt DigestSender encrypts the digest with their Private Key. This encrypted digest is the Digital Signature
3. Distribute PackageThe original document, the digital signature, and the sender’s public certificate are sent to the recipient

The Verification Mechanism

StepDescription
1. Decrypt SignatureReceiver decrypts the signature using the sender’s Public Key to reveal the original digest
2. Independent Re-hashReceiver hashes the received document using the same algorithm to compute a new digest
3. Comparative CheckIf both digests match, the document is authentic and unaltered. If they differ, the signature is invalid

Functions of Digital Signatures

FunctionDescription
IntegrityProves that the document has not been modified since the signature was applied
AuthenticationConfirms the origin of the document by linking it to the owner of the private key
Non-repudiationThe signer cannot deny having signed the document, as only they possess the private key

PART 9: ADVANCED SIGNATURES

9.1 Advanced Malware Signatures

Beyond exact byte matching: advanced techniques prove family membership, suspicious behaviour, authenticated integrity, or signer identity.

Key Distinction: A digital signature (asymmetric crypto) authenticates a signer’s identity and ensures document integrity — it is not the same as a malware-detection signature (byte pattern / YARA rule used by AV to identify malicious code). Conflating the two is a common exam error.


9.2 Fuzzy Hashing

Why Fuzzy Hashing?

Limitations of Cryptographic Hashes:

  • Cryptographic hashes (like SHA-256) are designed for Exact Integrity
  • Avalanche Effect: A single bit change results in a completely different, unrelated digest
  • Polymorphism: Malware authors modify a few bytes to evade signature-based detection
  • Identity vs. Similarity: Traditional hashes prove identity but fail to recognize “kinship” or structural overlap
  • The Detection Gap: If a malware variant is 99% identical to a known threat, an exact hash lookup will return 0% match

The Fuzzy Hashing Solution

Context-Triggered Piecewise Hashing (CTPH) enables the detection of structurally similar files.

FeatureDescription
Comparable SignaturesSimilar inputs produce similar digests that can be algorithmically compared
Variant DetectionEfficiently clusters modified malware, recompiled code, and phishing documents
RobustnessSurvives minor additions, deletions, or substitutions within the byte stream
Similarity ScoringProvides a score between 0 and 100 to indicate structural similarity

9.3 SSDEEP Algorithm

Process Flow

StepDescription
01 Block Size SelectionDetermines an initial block size b based on file length. The goal is to produce a signature of manageable length (typically 32 to 64 characters) to facilitate efficient comparison
02 Rolling Hash & Trigger BoundariesA weak rolling hash (Fowler-Noll-Vo) slides byte-by-byte across the file. A segment boundary is “triggered” when the hash state matches a specific condition relative to the block size. Condition: rolling_hash % b == (b - 1)
03 Piecewise HashingFor each identified segment, a stronger 6-bit non-cryptographic hash is computed. This reduces the entire chunk of data into a single Base64 character in the final fuzzy signature string
04 Dual-Signature GenerationTo account for slight variations in file size or small insertions/deletions, SSDEEP outputs two signatures: one at block size b and another at 2b. Format: block_size : hash_b : hash_2b
05 Edit Distance ComparisonSignatures are compared using a weighted Edit Distance (Levenshtein) algorithm. A score of 100 indicates an identical structure, while 0 indicates no detectable similarity

9.4 Fuzzy Hash Use Cases and Alternatives

AlgorithmMechanism & Primary StrengthLimitation / Note
SSDEEPContext-Triggered Piecewise Hashing (CTPH). Widely supported in threat intelligenceBrittle to significant byte reordering or content shuffling
TLSHTrend Micro Locality Sensitive Hash. Uses global clustering for robust similarityMore resilient to reordering than SSDEEP; requires minimum file size
SDHashSimilarity Digest. Uses Bloom filters to capture structural and statistical featuresExcellent for cross-correlation between different file formats
LZJDLempel-Ziv Jaccard Distance. Uses compression-set logic for similarityEffective for comparing heavily packed or compressed binary files

Key Use Cases

Use CaseDescription
Variant DetectionIdentify modified versions of known malware
Malware ClusteringGroup similar malware samples by structural similarity
Phishing SimilarityDetect similar phishing documents and websites
Code AttributionLink malware to known threat actors or families
Incident TriageQuickly prioritize and categorize detected threats

Key Teaching Point: Fuzzy similarity scores (0-100) provide evidence of structural relation, not absolute proof of malicious intent or definitive attribution. Thresholds must be tuned to the specific context of the investigation.


9.5 CFG Hashing and Import Hashing

Control Flow Graph (CFG) Hashing

FeatureDescription
Structural AnalysisMaps basic blocks (nodes) and control flows like jumps/calls (edges)
ResilienceSurvives instruction substitution, dead-code insertion, and minor code reordering
ClusteringSupports graph isomorphism and similarity analysis to group malware families
BinDiff IntegrationFacilitates binary-level comparison between malware versions

Import Hashing (ImpHash)

FeatureDescription
API ProfileComputes a hash based on the ordered list of imported libraries and functions
EfficiencyRapidly groups PE (Portable Executable) malware samples from the same builder or campaign
FingerprintingIdentifies common developer environments or malicious frameworks
LimitationDynamic imports (e.g., LoadLibrary/GetProcAddress) and obfuscation can hide API usage from static ImpHash analysis

PART 10: TECHNIQUE SELECTION MATRIX

Selecting the Optimal Integrity and Recovery Technique

Operational RequirementRecommended Technique
Detect accidental data corruption (networks/storage)CRC-32 / Adler-32 Checksums
Verify exact file integrity & known malware lookupsSHA-256 Cryptographic Hash
Ensure message integrity with authenticationHMAC (Keyed-Hash Message Authentication)
Verify file origin, integrity, and non-repudiationDigital Signatures (Hash + Asymmetric)
Identify structurally similar malware variantsSSDEEP / TLSH (Fuzzy Hashing)
Analyze binary code structure and relationshipsCFG Hashing / BinDiff
Group malware by API function call profilesImpHash (Import Hashing)
Maintain continuous service and availabilityRAID / Clusters / 3-2-1 Backups

PART 11: KEY TAKEAWAYS

Disaster Recovery

  • BCP = Organizational resilience; DRP = Technical restoration
  • BIA is the foundation: without it, RTO/RPO decisions are guesswork
  • RTO + WRT ≤ MTD is the fundamental recovery constraint
  • Recovery strategies: Hot (fastest, costliest) → Warm → Cold (slowest, cheapest)
  • 3-2-1-1-0 Rule: 3 copies, 2 media, 1 off-site, 1 immutable, 0 unverified

Fault Tolerance

  • Fault Tolerance = Zero downtime; High Availability = Minimized downtime; DR = Service restoration
  • RAID is NOT a backup: Protects against hardware failure only
  • RAID 5 (1 disk failure) vs RAID 6 (2 disk failures) vs RAID 10 (performance)
  • Clustering: Active-Passive (simple) vs Active-Active (complex, high throughput)

Detection Techniques

  • Signatures = Fast, precise, but blind to zero-day
  • Heuristics/Sandboxing = Detect unknown threats, but may have false positives
  • Cryptographic Hashes = Exact integrity verification (SHA-256 is standard)
  • MD5/SHA-1 are broken → Migrate to SHA-256 or SHA-3
  • Fuzzy Hashing (SSDEEP) = Detect similar/related files, not exact matches
  • Digital Signatures = Integrity + Authentication + Non-repudiation

On this page

TABLE OF CONTENTPART 1: DISASTER RECOVERY FUNDAMENTALSPART 2: RECOVERY METRICS AND TIERSPART 3: BACKUP STRATEGIESPART 4: FAULT TOLERANCEPART 5: ANTI-MALWARE AND DETECTIONPART 6: SIGNATURE-BASED DETECTIONPART 7: CHECKSUMS AND ERROR DETECTIONPART 8: CRYPTOGRAPHIC HASHESPART 9: ADVANCED SIGNATURESPART 10: TECHNIQUE SELECTION MATRIXPART 11: KEY TAKEAWAYSPART 1: DISASTER RECOVERY FUNDAMENTALS1.1 Why Plan for the Worst?Defining a DisasterTypes of DisastersCritical Planning PrinciplesThe Recovery Paradox1.2 Business Continuity vs. Disaster Recovery1.3 Business Impact Analysis (BIA): The Planning FoundationThe Six-Step BIA ProcessImpact DimensionsPART 2: RECOVERY METRICS AND TIERS2.1 Core Recovery MetricsThe Fundamental Recovery ConstraintSystem Availability Formula2.2 Availability and Recovery Tiers2.3 Recovery Strategies and DRP LifecycleDRP Lifecycle PhasesRecovery Site TypesDRP Testing Ladder2.4 Historical Case: Maersk NotPetya Recovery (2017)Incident OverviewThe “Ghana Miracle”Strategic Security LessonsPART 3: BACKUP STRATEGIES3.1 The Strategic BalanceKey Strategic DecisionsPrimary Drivers3.2 Backup Types ComparedBackup Schedule StrategiesFull + Daily IncrementalFull + Daily DifferentialComparison TableContinuous Data Protection (CDP) / Near-CDP3.3 The 3-2-1 and 3-2-1-1-0 RulesThe Classic 3-2-1 RuleThe Modern 3-2-1-1-0 Rule3.4 Backup Media and Location DecisionsStorage Media ComparisonLocation & Disaster Risk3.5 Backup Verification ChecklistThe Strategic MandateRecovery Success CriteriaPART 4: FAULT TOLERANCE4.1 Fault Tolerance vs High Availability vs Disaster RecoveryComparison FrameworkFailure Scope Hierarchy4.2 Redundancy Layers & Single Points of FailurePower RedundancyHardware RedundancyNetwork RedundancySoftware RedundancyData RedundancyGeographic Redundancy4.3 RAID Building BlocksRAID ConceptsRAID Is Not a Backup4.4 RAID LevelsRAID Level ComparisonThe Hot Spare StrategyRAID 5 RisksRAID 6 Advantages4.5 High-Availability ClusteringActive-Passive ModelActive-Active ModelThe Failover MechanismPART 5: ANTI-MALWARE AND DETECTION5.1 Antivirus SoftwareDefinitionAV Core ObjectivesScanning MethodsThe Modern Shift5.2 Detection MethodologiesDetection Methodology Trade-offsOperational Best PracticesCritical Security Gaps5.3 Spyware Threat ProfileTypes of SpywareInfection IndicatorsDetection SourcesSafe Response & RemovalPART 6: SIGNATURE-BASED DETECTION6.1 What is a Malware Signature?Six Typical Signature FormsExact Identity vs. Family / BehaviourSpecificity Spectrum6.2 Creating and Using a SignatureThe Signature LifecycleOperational GuidelinesIllustrative YARA Rule6.3 Why Typical Signatures FailFundamental WeaknessesStructural Code EvasionFileless & Memory-Only ThreatsPART 7: CHECKSUMS AND ERROR DETECTION7.1 Simple Byte-Stream ChecksumMechanics of OperationNumerical Example: “Hi”Inherent WeaknessesKey Takeaway7.2 CRC: Cyclic Redundancy CheckHow CRC WorksCommon ApplicationsThe Security Boundary7.3 Custom ChecksumsDesign RequirementsCommon Algorithmic OptionsPosition-Weighted SchemesCritical LimitationThe Golden Selection RuleVerification ChecklistPART 8: CRYPTOGRAPHIC HASHES8.1 Cryptographic Hash FundamentalsCore Properties8.2 Major Hash Algorithms Compared8.3 Why MD5 and SHA-1 Are BrokenThe Core Threat: Collision AttacksMD5 (128-bit)SHA-1 (160-bit)Security Mandate: Immediate Migration Required8.4 Hashes in File Integrity and Malware DetectionFile Integrity & BaselinesMalware Identification8.5 Digital SignaturesThe Signing MechanismThe Verification MechanismFunctions of Digital SignaturesPART 9: ADVANCED SIGNATURES9.1 Advanced Malware Signatures9.2 Fuzzy HashingWhy Fuzzy Hashing?The Fuzzy Hashing Solution9.3 SSDEEP AlgorithmProcess Flow9.4 Fuzzy Hash Use Cases and AlternativesKey Use Cases9.5 CFG Hashing and Import HashingControl Flow Graph (CFG) HashingImport Hashing (ImpHash)PART 10: TECHNIQUE SELECTION MATRIXSelecting the Optimal Integrity and Recovery TechniquePART 11: KEY TAKEAWAYSDisaster RecoveryFault ToleranceDetection Techniques