Skip to content

Commit

Permalink
memcg: cleanup racy sum avoidance code
Browse files Browse the repository at this point in the history
We used to have per-cpu memcg and lruvec stats and the readers have to
traverse and sum the stats from each cpu.  This summing was racy and may
expose transient negative values.  So, an explicit check was added to
avoid such scenarios.  Now these stats are moved to rstat infrastructure
and are no more per-cpu, so we can remove the fixup for transient negative
values.

Link: https://lkml.kernel.org/r/20210728012243.3369123-1-shakeelb@google.com
Signed-off-by: Shakeel Butt <shakeelb@google.com>
Acked-by: Roman Gushchin <guro@fb.com>
Reviewed-by: David Hildenbrand <david@redhat.com>
Acked-by: Michal Hocko <mhocko@suse.com>
Cc: Johannes Weiner <hannes@cmpxchg.org>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
  • Loading branch information
Shakeel Butt authored and Linus Torvalds committed Sep 3, 2021
1 parent ec403e2 commit 96e51cc
Showing 1 changed file with 2 additions and 13 deletions.
15 changes: 2 additions & 13 deletions include/linux/memcontrol.h
Original file line number Diff line number Diff line change
Expand Up @@ -977,30 +977,19 @@ static inline void mod_memcg_state(struct mem_cgroup *memcg,

static inline unsigned long memcg_page_state(struct mem_cgroup *memcg, int idx)
{
long x = READ_ONCE(memcg->vmstats.state[idx]);
#ifdef CONFIG_SMP
if (x < 0)
x = 0;
#endif
return x;
return READ_ONCE(memcg->vmstats.state[idx]);
}

static inline unsigned long lruvec_page_state(struct lruvec *lruvec,
enum node_stat_item idx)
{
struct mem_cgroup_per_node *pn;
long x;

if (mem_cgroup_disabled())
return node_page_state(lruvec_pgdat(lruvec), idx);

pn = container_of(lruvec, struct mem_cgroup_per_node, lruvec);
x = READ_ONCE(pn->lruvec_stats.state[idx]);
#ifdef CONFIG_SMP
if (x < 0)
x = 0;
#endif
return x;
return READ_ONCE(pn->lruvec_stats.state[idx]);
}

static inline unsigned long lruvec_page_state_local(struct lruvec *lruvec,
Expand Down

0 comments on commit 96e51cc

Please sign in to comment.