Transaction Inclusion Rates: When and Why Transactions Get Dropped
Examine the journey from mempool submission to block inclusion, analyzing why some transactions confirm quickly while others languish or disappear entirely.
Transcript
When your transaction vanishes from the mempool without making it into a block, understanding why requires seeing the invisible marketplace where space itself becomes the currency.
Think of the mempool as a waiting room that exists everywhere and nowhere simultaneously. Every node on the network maintains its own version of this waiting room, and while they look similar, they're not identical. When you broadcast a transaction, you're not submitting it to one central location. You're releasing it into a propagation network where it spreads from node to node, each one deciding independently whether to accept it, store it, and pass it along. This fundamental architecture explains why transaction inclusion is far more complex than simply joining a queue.
The first moment of truth comes at acceptance. Your transaction must meet basic validity requirements before any node will even consider holding it in memory. The signature must be cryptographically valid. The inputs must reference unspent outputs that actually exist. The transaction structure must conform to consensus rules. But validity alone doesn't guarantee propagation. Each node applies its own policies about what kinds of transactions it's willing to relay. Some nodes reject transactions below a certain fee rate. Others filter out transactions with non-standard scripts or unusual characteristics. Your transaction might be perfectly valid by consensus rules but still fail to propagate widely because individual nodes exercising their discretion decline to pass it forward.
Assuming your transaction achieves broad propagation and sits in mempools across the network, it enters a continuous auction for block space. Miners and validators selecting transactions for inclusion are optimizing for revenue within constraints. The primary constraint is block size or weight. The optimization goal is maximizing fee revenue. This creates a simple economic sorting mechanism where transactions are roughly ordered by fee rate, measured in satoshis per virtual byte or the equivalent in other networks. When blocks are being produced regularly and mempool depth is shallow, nearly everything above the minimum relay fee gets included quickly. The auction barely functions because supply exceeds demand. But when transaction volume surges, the auction becomes brutal and revealing.
During periods of congestion, the mempool develops layers like sediment in geological time. At the top sit transactions paying premium rates, virtually guaranteed inclusion in the next block. Below them, transactions paying moderate rates that will confirm within a few blocks. Deeper still, transactions paying minimum rates that might wait hours or days. And at the bottom, transactions paying below the dynamic minimum that nodes are currently willing to accept into their mempools at all. This layering is not static. As new transactions arrive paying higher fees, they displace older transactions downward in the priority ordering. The mempool has finite memory, and when it fills, nodes begin evicting the lowest fee rate transactions to make room for newcomers willing to pay more.
Here's where transactions begin disappearing. A transaction evicted from mempools hasn't been rejected by consensus. It hasn't been deemed invalid. It simply lost the competition for scarce memory resources. From the network's perspective, it's as if that transaction was never broadcast. The sender's wallet might still show it as pending, but it exists now only in local memory, no longer propagating through the network. Eventually, most wallets will abandon these transactions and return the funds to spendable status, but the timing varies by implementation. Some wallets abandon after a few hours, others after days, and some never abandon automatically at all.
Transaction replacement adds another dimension to this competition. Replace-by-fee mechanisms allow you to broadcast a new version of your transaction that spends the same inputs but pays a higher fee. The new version explicitly signals that it replaces the old one. Nodes that receive the replacement will drop the original from their mempools and accept the new version instead. Only one version can ultimately be mined because both spend the same inputs, making them mutually exclusive. This creates a deliberate mechanism for repricing your bid in the block space auction, but it also introduces complexity. The replacement must pay not just a higher absolute fee but a higher fee rate and must compensate for the bandwidth costs of the additional transaction data. Not all wallets support replacement. Some exchanges and services explicitly reject transactions signaling replaceability because it complicates their accounting.
Then there are the subtle network effects that influence inclusion beyond pure fee economics. Transaction dependency creates ordering requirements. If transaction B spends an output created by transaction A, then A must be confirmed before B can be. Miners often consider packages of related transactions together, evaluating the combined fee rate. A low-fee parent transaction might get pulled into a block because it's packaged with a high-fee child. Child pays for parent schemes exploit this explicitly, allowing you to bump a stuck transaction by spending one of its outputs with a high fee, incentivizing miners to include both together.
Mempool synchronization across the network is imperfect and creates arbitrage opportunities. A transaction might be well-distributed across most nodes but absent from the mempool of the specific miner who finds the next block. That miner cannot include what they haven't seen. Network latency, node connectivity, and propagation patterns all introduce variation. Some transactions reach miners immediately, others with delay, and some never arrive at all due to network partitions or peering topology. Mining pools with better connectivity and more sophisticated mempool management have an edge in capturing fee revenue.
Timing introduces another variable that many overlook. A transaction broadcast just after a block is found has maximum opportunity for inclusion in subsequent blocks. A transaction broadcast just before a block is found might not propagate to the winning miner in time, missing that block despite paying competitive fees. Over longer timeframes, this randomness averages out, but for individual transactions, timing can matter significantly. Broadcasting during periods of low activity increases the probability of quick confirmation at minimal cost. Broadcasting during peak usage times means entering a crowded auction where your fee might be competitive at submission but inadequate ten minutes later as new transactions arrive bidding higher.
Some transactions disappear for reasons that have nothing to do with fees or network propagation. Double spending attempts create conflicting transactions that spend the same inputs. Only one can ultimately confirm. The other will be permanently rejected once its competitor makes it into a block. Transactions depending on unconfirmed inputs inherit risk from their parents. If the parent transaction gets dropped or double-spent, all descendants become invalid and vanish from mempools instantly.
Certain transactions encounter policy-based rejection that's distinct from consensus invalidity. Transactions touching outputs associated with sanctioned addresses might be filtered by compliant miners. Transactions with unusual scripts or excessive witness data might be deprioritized or rejected by nodes running conservative policies. These policy decisions exist in a layer above consensus rules, creating a soft filter that affects propagation and inclusion without making transactions technically invalid.
The gap between transaction broadcast and block inclusion is fundamentally a market clearing mechanism operating under unique constraints. Space is artificially limited by protocol rules. Demand fluctuates wildly. Pricing happens through a continuous auction with imperfect information. Your transaction's fate depends on how your bid compares to competing bids, how widely your transaction propagates, whether miners see it before producing blocks, and whether you've structured it in ways that align with or conflict with network policies. Understanding this invisible marketplace explains why some transactions confirm instantly while others languish for days or vanish entirely, never achieving the permanence of blockchain inclusion.
See you Saturday. Your transaction is a bid in an auction where the room constantly changes size and other bidders can't see each other clearly.