How to Calculate Enthalpy: Determining Coil Loads and Equipment Sizing for HVAC Systems
← Back to Blog
Psychrometrics April 22, 2026 11 min read

How to Calculate Enthalpy: Determining Coil Loads and Equipment Sizing for HVAC Systems

Problem Framing

Skipping enthalpy calculation produces two failure modes in coil and chiller sizing. (1) Undersizing: sizing a chilled-water coil only on sensible ΔT (e.g., 20°F drop) without latent load from humid outdoor air leaves supply air dew point above space dew point, causing duct condensation, microbial growth on insulation, and ASHRAE 55-2020 comfort violation when indoor RH exceeds 65%. Houston / Miami / Tampa climate zones (CZ 2A, 1A) routinely have 60-75% outdoor RH at design conditions, making latent load 30-50% of total cooling load — substantial enough that ignoring it undersizes the coil by the same fraction. (2) Oversizing: assuming 100% outdoor air enthalpy when the system actually operates at 20-30% outdoor air overestimates Δh by 50-70%, sizing a chiller 1.3-1.5× larger than needed. Oversized chillers operate at low part-load most hours, with IPLV efficiency 15-25% worse than properly-sized units per AHRI 551/591 part-load methodology.

Enthalpy difference drives the thermal energy a coil must add or remove, making it the foundational calculation for any air-side HVAC component. Without it, engineers rely on rules of thumb like 400 CFM per ton, which fail in humid climates or with high outdoor air fractions, risking both comfort complaints and equipment failure. For accurate altitude corrections that affect air density and thus enthalpy-based load calculations, refer to How to Apply Altitude Correction in HVAC.

Exact Formula / Method

Metric: h = 1.006 × T_db + (W / 1000) × (2501 + 1.86 × T_db) [kJ/kg dry air]
Imperial: h = 0.240 × T_db + (W / 7000) × (1061 + 0.444 × T_db) [BTU/lb dry air]

T_db is dry-bulb temperature in °C (metric) or °F (imperial), representing the sensible heat content of the air-vapor mixture; it typically ranges from -60 to 65°C in HVAC applications, with design conditions often between 20-40°C for cooling. The coefficient 1.006 kJ/kg·°C (0.240 BTU/lb·°F) is the specific heat of dry air at constant pressure, capturing the energy required to change air temperature without phase change. W is humidity ratio in g/kg (metric) or gr/lb (imperial), derived from relative humidity, wet-bulb, or dew point measurements using saturation vapor pressure equations. ASHRAE Handbook Fundamentals Chapter 1 (Psychrometrics) specifies the Hyland-Wexler equations (equations 5 and 6 of the chapter) as the primary calculation method, with rated accuracy ±0.04% across HVAC operating ranges. The Magnus formula (P_sat = 0.61078 × exp(17.625 × T / (243.04 + T)) for T in °C, P_sat in kPa) is a simpler empirical approximation accurate to ±0.4% for 0-50°C and is commonly used for screening calculations and software defaults; for compliance-grade sizing use Hyland-Wexler. Realistic W values range from 0 g/kg in arid climates to 20 g/kg in tropical conditions, with 10-15 g/kg common in mixed-air streams.

The term (W / 1000) converts humidity ratio to kg water per kg dry air, needed because enthalpy is expressed per unit mass of dry air; dry air mass remains constant through HVAC processes while water vapor mass changes. The latent heat component (2501 + 1.86 × T_db) kJ/kg (1061 + 0.444 × T_db) BTU/lb represents the energy bound in water vapor, where 2501 kJ/kg is the latent heat of vaporization at 0°C, and 1.86 × T_db accounts for the temperature dependence of vapor enthalpy. This formulation ensures accuracy across the full HVAC temperature range, as derived from ASHRAE Handbook Fundamentals 2021 Chapter 1 (Psychrometrics) thermodynamic property equations. For coil load, the enthalpy difference Δh = h₁ - h₂ is multiplied by mass airflow: Q = (airflow × 1.2 / 3600) × Δh in kW (metric) or Q = 4.5 × CFM × Δh in BTU/h (imperial), where 1.2 kg/m³ is standard air density and 4.5 = 60 min/h × 0.075 lb/ft³.

Inputs Explained

Dry-bulb temperature is measured with a calibrated thermometer or obtained from design weather data like ASHRAE Climate Design Data; an error of ±2°C changes enthalpy by approximately ±2 kJ/kg (sensible component dominant at moderate humidity), leading to 4-8% coil load miscalculation at typical Δh = 25-50 kJ/kg ranges. Humidity inputs are critical: relative humidity from a hygrometer can drift by ±5% in field measurements, affecting W by up to 1 g/kg, which shifts latent enthalpy by ~2.5 kJ/kg per ASHRAE Handbook Fundamentals Chapter 1 — enough to misjudge dehumidification capacity by 5-10% in coil sizing. Wet-bulb temperature, measured with a sling psychrometer, is more reliable for enthalpy calculation in mixed-air streams but requires careful aspiration to avoid radiation errors; it typically ranges from 10-25°C in cooling design.

Engineers commonly misuse outdoor air fraction in mixed-air enthalpy calculations, leading to errors in coil load. For example, assuming 100% outdoor air for a system with 30% outdoor air overestimates Δh by 70%, resulting in an oversized coil that short-cycles and wastes energy. Airflow in CFM or m³/h must be the actual mass flow through the coil, not nominal fan rating; using design airflow instead of measured airflow after duct losses can underestimate load by 5-15% (typical duct system airflow shortfall per AABC TAB report data; higher in poorly-balanced systems). Always verify airflow with a balancer's report or calculate it using duct velocity and area as shown in How to Calculate Duct Velocity.

Worked Example

Consider a 10,000 sq ft office in Atlanta with a variable air volume system handling 8,000 CFM (13,600 m³/h). Entering air is mixed from 30% outdoor air at 35°C dry-bulb and 60% RH, and 70% return air at 24°C and 50% RH. The coil must cool to 13°C and 90% RH for dehumidification. First, calculate humidity ratio using the Magnus formula: for outdoor air, P_sat = 0.61078 × exp(17.625 × 35 / (243.04 + 35)) = 5.63 kPa, P_v = 0.60 × 5.63 = 3.38 kPa, W_outdoor = 621.945 × 3.38 / (101.325 - 3.38) = 21.5 g/kg. Return air: P_sat = 2.98 kPa, P_v = 1.49 kPa, W_return = 9.3 g/kg. Mixed-air W = 0.3 × 21.5 + 0.7 × 9.3 = 6.45 + 6.51 = 12.96 ≈ 13.0 g/kg; T_db_mixed = 0.3 × 35 + 0.7 × 24 = 10.5 + 16.8 = 27.3°C.

Enthalpy for mixed air: h_mixed = 1.006 × 27.3 + (13.0 / 1000) × (2501 + 1.86 × 27.3) = 27.5 + 33.2 = 60.7 kJ/kg. Leaving air: W_leaving = 8.4 g/kg, h_leaving = 1.006 × 13 + (8.4 / 1000) × (2501 + 1.86 × 13) = 13.1 + 21.2 = 34.3 kJ/kg. Δh = 60.7 − 34.3 = 26.4 kJ/kg. Coil load Q = (13,600 × 1.2 / 3600) × 26.4 = 4.533 × 26.4 = 119.7 ≈ 120 kW. In Imperial: mixed air at 81.1°F and 91.0 gr/lb, h_mixed = 0.240 × 81.1 + (91.0 / 7000) × (1061 + 0.444 × 81.1) = 19.5 + 0.01300 × 1097.0 = 19.5 + 14.3 = 33.8 BTU/lb; leaving air at 55.4°F and 58.8 gr/lb, h_leaving = 0.240 × 55.4 + (58.8 / 7000) × (1061 + 0.444 × 55.4) = 13.3 + 0.00840 × 1085.6 = 13.3 + 9.1 = 22.4 BTU/lb; Δh = 33.8 − 22.4 = 11.4 BTU/lb; Q = 4.5 × 8,000 × 11.4 = 410,400 BTU/h ≈ 410,000 BTU/h. This load dictates a chiller selection of approximately 34 tons (120 kW); 410,000 BTU/h ÷ 12,000 BTU/h per ton = 34.2 tons. SHR = 1.006 × (27.3 − 13) / 26.4 = 14.39 / 26.4 = 0.55, indicating high latent fraction requiring deep coil rows or enhanced dehumidification.

What the Result Means

An enthalpy difference of 26.4 kJ/kg (11.4 BTU/lb) in this example signals a cooling coil must remove both significant sensible and latent heat, with SHR of 0.55 below the typical 0.75-0.80 for standard commercial equipment. If SHR is below 0.70, select a coil with a lower apparatus dew point or add a desiccant system to avoid moisture carryover. For energy recovery ventilators, an outdoor-to-exhaust Δh exceeding 10 kJ/kg (4.3 BTU/lb) typically makes an enthalpy wheel cost-effective. ASHRAE 90.1-2022 Section 6.5.6.1 and Table 6.5.6.1-1 require energy recovery based on climate zone, design outdoor air percentage, and operating hours: typical thresholds trigger ER when outdoor air is ≥10,000 CFM at >10% of supply, or at lower CFM thresholds when operating hours exceed 8,000/year. The required total effectiveness ranges 50-70% depending on climate zone (higher effectiveness required in extreme climates CZ 1A, 7A, 8). See How to Calculate Energy Recovery Wheel Efficiency for the effectiveness calculation method.

Interpret the coil load result against manufacturer ratings: a 120 kW load requires a chiller sized to the nearest standard capacity, often 125 kW, but verify part-load performance using IPLV calculations as detailed in How to Calculate Chiller IPLV. If Δh is negative, indicating heating mode, size the heating coil or heat pump for the absolute value of Δh. Example: |Δh| = 5 kJ/kg with 5,000 CFM (8,495 m³/h) airflow gives Q = 8,495 × 1.2 / 3600 × 5 = 14.2 kW heater capacity. For 10,000 CFM at the same Δh, capacity scales linearly to 28.3 kW. Always check unit consistency between CFM (volumetric) and the kW (power) result through density × time conversion. Always cross-check with air-side and water-side measurements during commissioning; a discrepancy over 10% suggests airflow or sensor issues.

Common Mistakes

Mixing humidity ratio units in the Imperial enthalpy formula causes order-of-magnitude errors. The Imperial formula requires W converted from gr/lb to lb_water/lb_dry_air via division by 7000: correct calculation for 80°F dry-bulb and 92.2 gr/lb is h = 0.240 × 80 + (92.2/7000) × (1061 + 0.444 × 80) = 19.2 + 0.01317 × 1096.5 = 19.2 + 14.4 = 33.6 BTU/lb. Forgetting the /7000 conversion produces h ≈ 95,000+ BTU/lb — typically caught at sanity check (HVAC enthalpy ranges 15-50 BTU/lb), but more subtle errors occur when engineers convert g/kg to gr/lb improperly: a 13 g/kg humidity ratio is 91 gr/lb (×7), not 13 gr/lb. The 7× scaling error produces h ≈ 35-40% off — large enough to oversize a coil by 30-50% but small enough to escape rough sanity checks.

Using the 4.5 factor in Q = 4.5 × CFM × Δh at high altitude ignores air density reduction. In Denver at 5,000 ft, density is 0.062 lb/ft³, so the correct factor is 60 × 0.062 = 3.72. Applying 4.5 overestimates load by 21%, causing an oversized coil that short-cycles, reduces dehumidification, and increases humidity by 10-15% in the space. This mistake is common in mountain region projects without altitude correction.

Confusing SHR at design conditions with manufacturer-rated SHR leads to equipment mismatch. A design SHR of 0.55 with a coil rated at 0.75 SHR results in insufficient moisture removal, leaving indoor RH above 60% and risking mold. Engineers must obtain extended performance data from manufacturers for actual entering conditions, not just ARI/AHRI test conditions at 80°F and 50% RH.

Try the Enthalpy Calculator

Use our free online calculator to perform this calculation instantly.

Open Enthalpy Calculator

When This Method Is Not Enough

This simplified enthalpy method assumes steady-state conditions and uniform air distribution, breaking down in spaces with high transient loads like gymnasiums or commercial kitchens where moisture generation spikes rapidly. For example, a kitchen with intermittent steam from cooking can cause humidity ratio to fluctuate by 5 g/kg within minutes, making an average enthalpy calculation inadequate for coil sizing; dynamic simulation or worst-case scenario analysis is required. Similarly, in multi-zone systems with varying loads, using a single mixed-air enthalpy overlooks zone-specific dehumidification needs, leading to overcooling in some zones and under-dehumidification in others.

The formula also neglects air stratification and non-ideal coil behavior, such as bypass factor or contact factor, which affect actual leaving conditions. In a data center with hot aisle/cold aisle containment, recirculation patterns create localized high-enthalpy pockets that the bulk air enthalpy misses, risking hotspot formation. For these cases, computational fluid dynamics or manufacturer-specific coil selection software that accounts for fin geometry and air velocity is necessary to predict accurate performance.

FAQ

How do I calculate enthalpy for mixed air conditions?

Mixed air enthalpy is a mass-weighted average: h_mixed = (CFM_OA / CFM_total) × h_OA + (CFM_RA / CFM_total) × h_RA, where CFM is volumetric airflow and h is enthalpy from single-state calculations. Use outdoor air fraction based on design or measured values; an error in this fraction carries through to coil load with the same percentage error.

What is the typical enthalpy range for HVAC design?

In cooling mode, entering air enthalpy ranges from 30-80 kJ/kg (13-34 BTU/lb) depending on climate, with values above 50 kJ/kg (21 BTU/lb) common in humid regions. For heating, enthalpy can be negative in cold dry air, down to -20 kJ/kg (-9 BTU/lb) in arctic conditions. ASHRAE Climate Design Data provides location-specific extremes for accurate sizing.

When should I use wet-bulb temperature instead of relative humidity for enthalpy?

Use wet-bulb in the field when measuring mixed-air streams: a sling psychrometer or aspirated wet-bulb sensor reads ±0.5°C accuracy in flowing air, while relative humidity sensors drift ±3-5% over time and are temperature-sensitive. Wet-bulb temperature combined with dry-bulb temperature uniquely defines air enthalpy at standard pressure, making it the preferred field metric for psychrometric calculations per ASHRAE Handbook Fundamentals Chapter 1 (Psychrometrics) Section 1.2 (Thermodynamic Properties of Moist Air). For energy recovery effectiveness calculations, ASHRAE Standard 84-2020 specifies enthalpy-based effectiveness as the primary method (ε_total = (h_oa − h_sa) / (h_oa − h_ra)), making accurate wet-bulb measurement at all three points critical.

Why does enthalpy use dry air mass as the basis?

Enthalpy is expressed per unit mass of dry air because dry air mass remains constant through HVAC processes, while water vapor mass changes. This consistency allows tracking of psychrometric properties without conversion errors, as standardized in ASHRAE Handbook Fundamentals Chapter 1 (Psychrometrics) — the choice of dry air mass as basis is consistent with all psychrometric chart conventions and software.

Can enthalpy be negative, and what does it indicate?

Yes, enthalpy can be negative when dry-bulb temperature is below the reference point of 0°C (32°F) and humidity ratio is low, such as in cold winter air. Negative enthalpy indicates the air has less total heat than the reference state, requiring heating to reach comfort conditions, and is common in heating load calculations for northern climates.

How does altitude affect enthalpy and coil load calculations?

Air density decreases with altitude (about 3% per 1,000 ft per ASHRAE Handbook Fundamentals Chapter 1 standard atmosphere model). The enthalpy formula h = c_p × T_db + W × h_v itself doesn't change; enthalpy is per unit mass of dry air. What changes is the conversion between volumetric airflow (CFM, m³/h) and mass airflow used in coil load calculation: at 5,000 ft elevation, density drops to ~0.062 lb/ft³ versus 0.075 at sea level, so the imperial coefficient in Q = factor × CFM × Δh becomes 60 × 0.062 = 3.72 instead of 4.5 (a 17% reduction). At 10,000 ft, the coefficient drops to ~3.04. The metric formula Q = V × ρ / 3600 × Δh handles altitude correctly when actual ρ is substituted. For accurate altitude correction, see How to Apply Altitude Correction in HVAC.

What's the difference between specific enthalpy and total enthalpy in coil load calculations?

Specific enthalpy (h, in kJ/kg or BTU/lb) is the energy per unit mass of dry air at a given state point. Total enthalpy (H, in kJ or BTU) is the time-integrated energy: H = mass airflow × h × time period. Coil load calculations use specific enthalpy difference Δh combined with mass airflow rate to give an instantaneous power (Q in kW or BTU/h); this is what equipment ratings express. For energy consumption analysis (Wh, BTU annually), integrate Q over operating hours: typical office cooling coils operate at full Q for 800-1,200 hours/year at peak conditions in CZ 4A-5A, with proportionally less at part-load. The distinction matters for energy recovery payback analysis, where annual energy savings (kWh) drive the economics rather than peak Δh.

Related Calculation to Check Next

After determining enthalpy and coil load, calculate the sensible heat ratio (SHR) to verify equipment compatibility. SHR = Δh_s / Δh, where Δh_s = 1.006 × (T_db1 - T_db2) in metric; if SHR is below 0.70, evaluate dehumidification enhancements like reheat or variable-speed compressors. Next, perform a psychrometric process analysis to plot state points and ensure the coil curve aligns with equipment capabilities, preventing moisture carryover. For systems with energy recovery, compute effectiveness using enthalpy differences as per How to Calculate Energy Recovery Wheel Efficiency.

Then, size ancillary components: use the latent load from enthalpy difference to size condensate pumps, ensuring they handle peak condensation rates without overflow. Refer to How to Size Condensate Pumps for flow rate calculations based on latent load and safety factors. Finally, validate the design with a cooling load calculation that integrates envelope and internal gains, as outlined in How to Calculate Cooling Load for HVAC Sizing, to ensure total system coherence.

Related Calculators