Skip to content

Commit

Permalink
cpuset: migrate memory only for threadgroup leaders
Browse files Browse the repository at this point in the history
If memory_migrate flag is set, cpuset migrates memory according to the
destnation css's nodemask.  The current implementation migrates memory
whenever any thread of a process is migrated making the behavior
somewhat arbitrary.  Let's tie memory operations to the threadgroup
leader so that memory is migrated only when the leader is migrated.

While this is a behavior change, given the inherent fuziness, this
change is not too likely to be noticed and allows us to clearly define
who owns the memory (always the leader) and helps the planned atomic
multi-process migration.

Note that we're currently migrating memory in migration path proper
while holding all the locks.  In the long term, this should be moved
out to an async work item.

Signed-off-by: Tejun Heo <tj@kernel.org>
Acked-by: Zefan Li <lizefan@huawei.com>
  • Loading branch information
Tejun Heo committed Sep 22, 2015
1 parent 472912a commit 3df9ca0
Showing 1 changed file with 22 additions and 18 deletions.
40 changes: 22 additions & 18 deletions kernel/cpuset.c
Original file line number Diff line number Diff line change
Expand Up @@ -1487,7 +1487,6 @@ static void cpuset_attach(struct cgroup_subsys_state *css,
{
/* static buf protected by cpuset_mutex */
static nodemask_t cpuset_attach_nodemask_to;
struct mm_struct *mm;
struct task_struct *task;
struct task_struct *leader = cgroup_taskset_first(tset);
struct cpuset *cs = css_cs(css);
Expand Down Expand Up @@ -1515,26 +1514,31 @@ static void cpuset_attach(struct cgroup_subsys_state *css,
}

/*
* Change mm, possibly for multiple threads in a threadgroup. This is
* expensive and may sleep.
* Change mm, possibly for multiple threads in a threadgroup. This
* is expensive and may sleep and should be moved outside migration
* path proper.
*/
cpuset_attach_nodemask_to = cs->effective_mems;
mm = get_task_mm(leader);
if (mm) {
mpol_rebind_mm(mm, &cpuset_attach_nodemask_to);

/*
* old_mems_allowed is the same with mems_allowed here, except
* if this task is being moved automatically due to hotplug.
* In that case @mems_allowed has been updated and is empty,
* so @old_mems_allowed is the right nodesets that we migrate
* mm from.
*/
if (is_memory_migrate(cs)) {
cpuset_migrate_mm(mm, &oldcs->old_mems_allowed,
&cpuset_attach_nodemask_to);
if (thread_group_leader(leader)) {
struct mm_struct *mm = get_task_mm(leader);

if (mm) {
mpol_rebind_mm(mm, &cpuset_attach_nodemask_to);

/*
* old_mems_allowed is the same with mems_allowed
* here, except if this task is being moved
* automatically due to hotplug. In that case
* @mems_allowed has been updated and is empty, so
* @old_mems_allowed is the right nodesets that we
* migrate mm from.
*/
if (is_memory_migrate(cs)) {
cpuset_migrate_mm(mm, &oldcs->old_mems_allowed,
&cpuset_attach_nodemask_to);
}
mmput(mm);
}
mmput(mm);
}

cs->old_mems_allowed = cpuset_attach_nodemask_to;
Expand Down

0 comments on commit 3df9ca0

Please sign in to comment.